Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Argon equation of state data to 1 TPa: Shock compression experiments and simulations

Argon is the most abundant noble gas on Earth and its noble, atomic fluid nature makes it an excellent candidate for comparison of experiment and theory at extreme conditions. For this study, we performed a combined computational and experimental study on shock compressed cryogenic liquid argon. Using Sandia's Z machine, we shock compressed liquid argon to 600 GPa and reshock states up to 950 GPa. Laser shock experiments at the Omega Laser facility extend the principal Hugoniot to 1000 GPa and provided temperature data along the principal Hugoniot. The plate impact experiments and laser shock experiments used well-characterized impedance matching standards and demonstrate consistent results between the two platforms over a common range. Density functional theory based molecular dynamics simulations provided additional data on the Hugoniot to 600 GPa. The combined experimental data and simulation results provide constraints on the development of new equation of state models at extreme conditions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Delta-Rice: A HDF5 Compression Plugin optimized for Digitized Detector Data

Delta-Rice is an HDF5 (The HDF Group et al., 2020) filter plugin that was developed to compress digitized detector signals recorded by the Nab experiment (Fry et al., 2019), a fundamental neutron physics experiment. This is a two-step process where incoming data is passed through a pre-processing filter and then compressed with Rice coding. A routine for determining the optimal pre-processing filter for a dataset is provided along with an example GPU deployment. When applied to data collected by the Nab data acquisition system, this method produced output files 29% their initial size, and was able to do so with an average read/write throughput in excess of 2 GB/s on a single CPU. Compared to the widely used Gzip compression routine, Delta-Rice reduces the file size by 33% more with over an order of magnitude increase in read/write throughput. Delta-Rice is available on CPU to users through the HDF5 library.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

$\mathrm{UPDATED}$ $\mathrm{U3SI2}$ thermal creep model and sensitivity analysis of the $\mathrm{U3SI2-SIC}$ accident tolerant $\mathrm{FUEL}$

U 3 Si 2 is a candidate accident tolerant fuel (ATF) replacement for UO 2 . U 3 Si 2 ’s high uranium density and high thermal conductivity are favorable properties in steady-state and accident conditions. Low power performance of this U3Si2-SiC concept fuel is compared to that of UO 2 -Zr4 fuels by implementing models that describe the properties of U 3 Si 2 and SiC-SiC into Idaho National Laboratory's (INL) fuel performance code, BISON. Included in these material models is a thermal creep model for U 3 Si 2 based on compressive creep data. The simulated results are in keeping with community knowledge that the U 3 Si 2 -SiC concept fuel may serve as a replacement for UO 2 -Zr4 fuels during steady-state operation, provided the mSiC layer remains under compression. Through a moderate power history and three 24-month fuel cycles, the mSiC layer remains under compressive stress through a burnup of 80 MWd/kgU. During low power operation, failure of the mSiC layer generally occurs prior to significant thermal creep in U 3 Si 2 . Generally, U 3 Si 2 creep is temperature sensitive and of little importance at the temperatures and stresses simulated during steady operation and during fuel-to-cladding contact. A parameter variation study including 11,520 individual simulations with variations in nominal fuel thermal creep rate, cladding thermal conductivity, cladding irradiation creep and swelling, cladding gap size, and cladding thickness demonstrated that research priorities for this ATF should revolve around reducing cladding thickness as a means to minimize cladding failure. Generally, despite advances in SiC-SiC compliance, the brittle nature of mSiC excludes U 3 Si 2 -SiC for use where fuel cladding contact may occur.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Feature identification or classification using task-specific metadata

Innovations in the identification or classification of features in a data set are described, such as a data set representing measurements taken by a scientific instrument. For example, a task-specific processing component, such as a video encoder, is used to generate task-specific metadata. When the data set includes video frames, metadata can include information regarding motion of image elements between frames, or other differences between frames. A feature of the data set, such as an event, can be identified or classified based on the metadata. For example, an event can be identified when metadata for one or more elements of the data set exceed one or more threshold values. When the feature is identified or classified, an output, such as a display or notification, can be generated. Although the metadata may be useable to generate a task-specific output, such as compressed video data, the identifying or classifying is not used solely in production of, or the creation of an association with, the task-specific output.

Teuton, Jeremy R.↗
DOE OSTI2019

Variable Precision Computing

This report summarizes the activities and major accomplishments of the Variable Precision Computing Strategic Initiative project. The overarching goal of this project was to initiate and promote a new paradigm in High Performance Computing (HPC) that would fundamentally change how we represent and make use of representations of real numbers in finite precision and that would establish Lawrence Livermore National Laboratory (LLNL) as a leader in precision-related research for HPC. We pursued three integrated and concurrent research thrusts: new, more dynamic data representations to address data motion and capacity limitations; improved mixed precision algorithms to accelerate computation and to leverage new hardware; and new tools to help developers reason about precision and to automate code transformations. Within these thrust areas, we made significant advances in the use of compressed array data types in numerical calculations, in the theoretical justification, in improved performance, and in the prospects of hardware implementation; in the development of metrics to significantly reduce the storage needs of molecular dynamics simulations; in the development and analysis of efficient mixed-precision algorithms for time-dependent partial differential equations and for orthogonal factorization; and in the capability of tools that can analyze sensitivity of computed results to choices in precision and that can make automated code transformations based on such analysis. We established that there are definite opportunities to realize significant improvements in HPC above and beyond the 2x limits of traditional mixed precision using the technologies we have developed. The project produced numerous papers, presentations, and posters in important venues as well as open-source software contributions to the community, and many of the new capabilities have initiated or are being leveraged in ongoing projects.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Custom NEON AOP reflectance mosaics and maps of shade masks, canopy water content

This mosaic of visible to shortwave infrared (VSWIR) data was derived from the assignable asset NEON AOP radiance data that was collected by LBNL’s Watershed Function SFA during the summer of 2018 (DOI: 10.15485/1617204). This atmospheric correction was completed to take into account site-specific terrain variability in the 334 km2 survey area centered around Crested Butte, CO. The atmospheric correction was completed using ACORN atmospheric correction software executed on 200 x 200 pixel kernels rather than line by line in order to capture local flight altitude conditions. Manual cloud delineation removed any small shaded areas that occurred within the data collection areas. Mosaics were developed based on preference for days that were in close timing proximity to the coincident ground campaign and with mosaicing criteria that minimized the angle between the sun and the sensor to retrieve the most consistent reflectance (min_phase_refl_tiled). Finally, we generated shade masks based on the geometry between the sun angle at time of flight, the ground surface, and the sensor. Here we provide the orthomosaiced estimated reflectance data (min_phase_refl_tiled.tif), canopy water content (wtrl), estimated atmospheric water vapor (wtrv), the observational data (obs) for this particular mosaic, the estimated visibility (vis), shade masks derived from the digital surface elevation model (shade) and the digital terrain model (shade_tch) added to the canopy height model (DOI: 10.15485/1617203), and a wavelength metadata file. Each image file is provided as a GeoTiff with internal tiling and LZW compression. These data can also be found on Google Earth Engine for extraction, download, and analysis of smaller extents (Google Earth Engine data is linked in external link table).

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2023

Spatiotemporally Adaptive Compression for Scientific Dataset with Feature Preservation – A Case Study on Simulation Data with Extreme Climate Events Analysis

Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations. In this paper, we propose a technique that addresses storage costs while improving post-analysis accuracy through spatiotemporal adaptive, error-controlled lossy compression. We investigate the trade-off between data precision and temporal output rates, revealing that reducing data precision and increasing timestep frequency lead to more accurate analysis outcomes. Additionally, we integrate spatiotemporal feature detection with data compression and demonstrate that performing adaptive error-bounded compression in higher dimensional space enables greater compression ratios, leveraging the error propagation theory of a transformation-based compressor. To evaluate our approach, we conduct experiments using the well-known E3SM climate simulation code and apply our method to compress variables used for cyclone tracking. Our results show a significant reduction in storage size while enhancing the quality of cyclone tracking analysis, both quantitatively and qualitatively, in comparison to the prevalent timestep decimation approach. Compared to three state-of-the-art lossy compressors lacking feature preservation capabilities, our adaptive compression framework improves perfectly matched cases in TC tracking by 26.4-51.3% at medium compression ratios and by 77.3-571.1% at large compression ratios, with a merely 5–11% computational overhead.

Gong, Qian↗
DOE OSTI2023

Direct prediction of inelastic neutron scattering spectra from the crystal structure*

Abstract Inelastic neutron scattering (INS) is a powerful technique to study vibrational dynamics of materials with several unique advantages. However, analysis and interpretation of INS spectra often require advanced modeling that needs specialized computing resources and relevant expertise. This difficulty is compounded by the limited experimental resources available to perform INS measurements. In this work, we develop a machine-learning based predictive framework which is capable of directly predicting both one-dimensional INS spectra and two-dimensional INS spectra with additional momentum resolution. By integrating symmetry-aware neural networks with autoencoders, and using a large scale synthetic INS database, high-dimensional spectral data are compressed into a latent-space representation, and a high-quality spectra prediction is achieved by using only atomic coordinates as input. Our work offers an efficient approach to predict complex multi-dimensional neutron spectra directly from simple input; it allows for improved efficiency in using the limited INS measurement resources, and sheds light on building structure-property relationships in a variety of on-the-fly experimental data analysis scenarios.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Cascade of transitions in twisted and non-twisted graphene layers within the van Hove scenario

Abstract Motivated by measurements of compressibility and STM spectra in twisted bilayer graphene, we analyze the pattern of symmetry breaking for itinerant fermions near a van Hove singularity. Making use of an approximate SU(4) symmetry of the Landau functional, we show that the structure of the spin/isospin order parameter changes with increasing filling via a cascade of transitions. We compute the feedback from different spin/isospin orders on fermions and argue that each order splits the initially 4-fold degenerate van Hove peak in a particular fashion, consistent with the STM data and compressibility measurements, providing a unified interpretation of the cascade of transitions in twisted bilayer graphene. Our results follow from a generic analysis of an SU(4)-symmetric Landau functional and are valid beyond a specific underlying fermionic model. We argue that an analogous van Hove scenario explains the cascade of phase transitions in non-twisted Bernal bilayer and rhombohedral trilayer graphene.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2019

Mesoscale Numerical Characterization of Kevlar and Carbon–Kevlar Hybrid Plain-Woven Fabric Compression Behavior

A mesoscale finite element model (FEM) of the plain-woven fabric representative elementary volume (REV/unit cell) is developed. The developed FEM is used to predict the nonlinear compaction behavior of monolithic and intraply hybrid fabric made of high-strength carbon and Kevlar fibers. For geometrical modeling of the fabric REV, TexGen, an open-source geometrical modeling software (developed at Nottingham University), is utilized, and for mechanical characterization, FE simulation tool Abaqus{sup ®} is used. Geometrical nonlinearity of the fabric, including periodic boundary conditions and yarn interactions, is incorporated in the REV FE model. Material nonlinearity caused by transversely isotropic behavior of fibrous yarns is implemented through the user material subroutine form in FE simulation along with local orientation assigned to each yarn in the REV. Material properties of fibers are extracted from the literature and supplier data. The compression behavior of monolithic Kevlar and hybrid carbon–Kevlar (carbon warp and Kevlar weft yarns, C–K) fabric is predicted using the proposed FE model. FEM-predicted results were found to have good agreement with the experimentally obtained ones. Results depict that C–K hybrid fabrics have improved compression strength. Hybridization effect is governed by yarns mutual interaction, yarn area at crossovers, and transverse in-plane properties of the interyarn hybridized fabric. The proposed FE model can be used to predict the mechanical behavior of woven fabrics with different weaving patterns, unit cell geometry, material properties, and loading conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2020

ROOT I/O compression improvements for HEP analysis

We overview recent changes in the ROOT I/O system, increasing performance and enhancing it and improving its interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly to improve experiment's software performance. The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased during the LHC era. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly: there are significant trade-offs between the increased CPU cost for reading and writing files and the reduce storage space.

Shadura, Oksana↗
DOE OSTI2021

Poisson’s ratio of eTPU molded bead foams in compression via in situ synchrotron X-ray microtomography

In situ synchrotron X-ray microtomography was used to characterize the bulk deformation behavior by computing the Poisson's ratio of expanded thermoplastic polyurethane (eTPU) molded bead foams used in footwear midsole during compression. Quantitative data on morphological characteristics were obtained using an iterative image processing workflow. Image correlation on the 4D datasets using DVC was performed to calculate the volumetric and axial strain to estimate the Poisson ratio. Strain maps from DVC showed the influence of variability in ligament thickness distribution on the global mechanical behavior exhibited which dominated the response seen in these bead foams. Lastly, our results showed a strong correlation between Poisson ratio and distribution of ligament thickness in foams.

36 MATERIALS SCIENCE↗
DOE OSTI2020

The Complicated Link Between Material Properties and Microfracture Density for an Underground Explosion in Granite

Geophysical techniques are often implemented as quick and inexpensive ways to locate and characterize fractures in the subsurface, which is important for a number of geoscience fields. Seismic velocities are the most widely used proxies for identification of fractures, but the correlation is not always well-defined. In this study we present material property data: unconfined compressive strength (UCS), bulk density (ρ), Young's modulus (E), Poisson's ratio (ν), P wave velocity (V p ), and S wave velocity (V s ), in conjunction with microfracture densities measured on samples of granite collected before and after underground chemical explosions. Results indicate the relationship between fractures and material properties is complex, even in this single-lithology environment. We interpret that this complexity arises from varying fracture mechanisms (e.g. dilation-inducing fractures vs compression-inducing fractures) in different parts of the core, due to differences in stress conditions. Additional complexity may result from chemical interactions between the fresh fractures and the fluids in the area. Water content appears to have a significant, if not dominant, role in the unconfined compressive strength (UCS) of the samples. We suggest caution when using elastic property measurements as a proxy for fracturing in areas of explosion-induced damage, or in other areas where a variety of mechanisms induce fracturing.

58 GEOSCIENCES↗
DOE OSTI2023

Cosmological constraints from the Subaru Hyper Suprime-Cam year 1 shear catalogue lensing convergence probability distribution function

Here we utilize the probability distribution function (PDF) of normalized convergence maps reconstructed from the Subaru Hyper Suprime-Cam (HSC) year 1 shear catalogue, in combination with the power spectrum, to measure the matter clustering amplitude S 8 = σ 8 $\sqrt {Ω_{m}/0.3}$. The large-scale structure’s statistical properties are incompletely described by the traditional two-point statistics, motivating our investigation of the PDF—a complementary higher-order statistic. By defining the PDF over the standard-deviation-normalized convergence map, we are able to isolate the non-Gaussian information. We use tailored simulations to compress the data vector and construct a likelihood approximation. We mitigate the impact of survey and astrophysical systematics with cuts on smoothing scales, redshift bins, and data vectors. We find S 8 = $0.860^{+0.066}_{–0.109}$ from the PDF alone and S 8 = 0.798$^{+0.029}_{–0.042}$ from the combination of the PDF and power spectrum (68% confidential level (CL)). The PDF improves the power-spectrum-only constraint by about 10%.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Pressure-temperature equation of state of Al 2 ⁢O 3 up to 14 Mbar and 40 kK

Sapphire (Al 2 ⁢O 3 ), known for its remarkable incompressibility at ambient conditions, plays a pivotal role in both static and dynamic compression research. Accurately characterizing its equation of state (EoS) is essential for these applications. Here, we present a complete Hugoniot of Al 2 ⁢ O 3 as locus of experimentally assessed, high-precision, pressure, density and temperature states up to 14 Mbar and 43 kK. The Hugoniot is established with single shock experiments using magnetically launched hyper velocity flyers on the Z Accelerator at Sandia National Laboratories. We explore principal Hugoniot states at very high shock 𝑇 and 𝑝 in the solid phase, tracking the solid-liquid boundary and culminating at 2.4-fold compression, where data provides a direct constraint on the liquid phase. Corresponding shock release data probe thermodynamic states complementary to the Hugoniot and place additional constraints on tabular EoS models. Our findings indicate a significant deviation from existing tabular EoS models for Al 2 ⁢ O 3 dictating a comprehensive overhaul. We develop two advanced EoSs for Al 2 ⁢ O 3 the SESAME 97412 model, featuring an extensive phase diagram that includes three solid phases and the liquid phase, and the updated LEOS 2200m2 model. EoS development is assisted with Quantum Molecular Dynamics simulations. Our experimental data allows for stringent testing of our EoSs. Both models accurately capture the Hugoniot of Al 2 ⁢O 3 up to the highest pressures and temperatures. Rigorous experimental determination of extreme pressures and temperatures, paired with sophisticated models, advances the frontier of EoS development beyond 1 terapascal.

Kalita, Patricia [Sandia National Laboratories (SN↗
DOE OSTI2022

Unified many-worlds browsing of arbitrary physics-based animations

Manually tuning physics-based animation parameters to explore a simulation outcome space or achieve desired motion outcomes can be notoriously tedious. This problem has motivated many sophisticated and specialized optimization-based methods for fine-grained (keyframe) control, each of which are typically limited to specific animation phenomena, usually complicated, and, unfortunately, not widely used. In this paper, we propose Unified Many-Worlds Browsing (UMWB), a practical method for sample-level control and exploration of physics-based animations. Our approach supports browsing of large simulation ensembles of arbitrary animation phenomena by using a unified volumetric WORLDPACK representation based on spatiotemporally compressed voxel data associated with geometric occupancy and other low-fidelity animation state. Beyond memory reduction, the WORLDPACK representation also enables unified query support for interactive browsing: it provides fast evaluation of approximate spatiotemporal queries, such as occupancy tests that find ensemble samples ("worlds") where material is either IN or NOT IN a user-specified spacetime region. WORLDPACKS also support real-time hardware-accelerated voxel rendering by exploiting the spatially hierarchical and temporal RLE raster data structure. Our UMWB implementation supports interactive browsing (and offline refinement) of ensembles containing thousands of simulation samples, and fast spatiotemporal queries and ranking. We show UMWB results using a wide variety of physics-based animation phenomena---not just JELL-O ® .

Computer Science↗
DOE OSTI2021

H5TurboPFor v0.0.1

H5TurboPFor is a wrapper for the TurboPFor-Integer-Compression for HDF5 library. Basically, it enables the HDF5 library to compress integer data using the TurboPFor.

Dong, Bin↗