Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Memory hierarchy using row-based compression

A system includes a first memory and a device coupleable to the first memory. The device includes a second memory to cache data from the first memory. The second memory includes a plurality of rows, each row including a corresponding set of compressed data blocks of non-uniform sizes and a corresponding set of tag blocks. Each tag block represents a corresponding compressed data block of the row. The device further includes decompression logic to decompress data blocks accessed from the second memory. The device further includes compression logic to compress data blocks to be stored in the second memory.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Neural-network learning of SPOD latent dynamics

Here, we aim to reconstruct the latent space dynamics of high dimensional, quasi-stationary systems using model order reduction via the spectral proper orthogonal decomposition (SPOD). The proposed method is based on three fundamental steps: in the first, once that the mean flow field has been subtracted from the realizations (also referred to as snapshots), we compress the data from a high-dimensional representation to a lower dimensional one by constructing the SPOD latent space; in the second, we build the time-dependent coefficients by projecting the snapshots containing the fluctuations onto the SPOD basis and we learn their evolution in time with the aid of recurrent neural networks; in the third, we reconstruct the high-dimensional data from the learnt lower -dimensional representation. The proposed method is demonstrated on two different test cases, namely, a compressible jet flow, and a geophysical problem known as the Madden-Julian Oscillation. An extensive comparison between SPOD and the equivalent POD-based counterpart is provided and differences between the two approaches are highlighted. The numerical results suggest that the proposed model is able to provide low rank predictions of complex statistically stationary data and to provide insights into the evolution of phenomena characterized by specific range of frequencies. The comparison between POD and SPOD surrogate strategies highlights the need for further work on the characterization of the interplay of error between data reduction techniques and neural network forecasts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Dense autoencoders, clustering techniques, and semi-supervised learning for HPGe $γ$-spectra

Classifying high-resolution gamma spectra by their isotopic content is an essential task in nuclear forensics and other applications. Traditional analysis methods are often time-intensive, but machine learning (ML) may help analysts quickly process many spectra. Such methods tend to rely on abundant, well-labeled data for training. Historical gamma data exists in various fields but is not uniformly useful for supervised ML due to inconsistent labeling. Here, to address some of these challenges, we present a method to classify and organize unlabeled data from high-purity germanium detectors using an autoencoding neural network (autoencoder). We trained dense autoencoders to compress gamma data into latent representations that enable efficient data characterization. By clustering the encoded spectra or lower-dimensional mappings of them, we identified and removed portions of over-abundant data categories, resulting in a more balanced dataset and improved autoencoder performance. This encoding and clustering pipeline also enabled the organization of spectra into self-consistent categories. Finally, we found that encoded representations showed potential as inputs for semi-supervised learning of nuclide identification (NID) labels, achieving an average F1 score of 0.85 ± 0.03 when mapping encodings to a set of 65 isotope labels.

Autoencoders↗
DOE OSTI2023

Quantifying uncertainty in analysis of shockless dynamic compression experiments on platinum. II. Bayesian model calibration

Dynamic shockless compression experiments provide the ability to explore material behavior at extreme pressures but relatively low temperatures. Typically, the data from these types of experiments are interpreted through an analytic method called Lagrangian analysis. Here, in this work, alternative analysis methods are explored using modern statistical methods. Specifically, Bayesian model calibration is applied to a new set of platinum data shocklessly compressed to 570 GPa. Several platinum equation-of-state models are evaluated, including traditional parametric forms as well as a novel non-parametric model concept. The results are compared to those in Paper I obtained by inverse Lagrangian analysis. The comparisons suggest that Bayesian calibration is not only a viable framework for precise quantification of the compression path, but also reveals insights pertaining to trade-offs surrounding model form selection, sensitivities of the relevant experimental uncertainties, and assumptions and limitations within Lagrangian analysis. The non-parametric model method, in particular, is found to give precise unbiased results and is expected to be useful over a wide range of applications. The calibration results in estimates of the platinum principal isentrope over the full range of experimental pressures to a standard error of 1.6%, which extends the results from Paper I while maintaining the high precision required for the platinum pressure standard.

Brown, Justin Lee↗
DOE OSTI2019

Transparent Asynchronous Zero-copy Remote I/O (TAZeR)

Transparent Asynchronous Zero-copy Remote I/O (TAZeR) is a framework built to facilitate grid computing by easing the memory movement and management across geographically separated computing resources. TAZeR employs a multiclient/ multi-server paradigm where data is stored at on a remote server. Users preload an interposing library which upon application start-up, stands up an ephemeral lightweight client. The client captures POSIX I/O calls to TAZeR meta-files which contains the IP address/port of the remote server, the location of the file on remote server, and additional meta-data. The client connects to the server using this information and begins downloading the file in parts optionally compressing the data.

Friese, Ryan↗
DOE OSTI2021

Real-Time Lossless Compression for Ultra-High-Density Synchrophasor and Point on Wave Data

Modern advanced Phasor Measurement Units (PMUs) are developed with ultra-high reporting rates to meet the demand for monitoring the power systems dynamics in detail. Due to the large volume of data, the communication and storage systems are seriously challenged with the presence of Ultra-High-Density (UHD) synchrophasor and Point on Wave (POW) data. Therefore, it is an urgent task to compress the UHD data for more efficient communication and data storage. This paper proposes several methods to compress the synchrophasor and POW data in a lossless manner. First, an Improved-Time-Series-Special Compression (ITSSC) method is proposed to compress the UHD frequency data. Second, a Delta-difference Huffman method is combined with the TSSC algorithm to compress the UHD phase angle data. Finally, a cyclical high-order delta modulation method is proposed to compress the UHD POW data. The proposed models are extensively tested and compared with different existing lossless compression algorithms using the field-collected synchrophasor and POW data at different reporting rates. The results indicate that the proposed algorithms are efficient in performing lossless compression for the UHD synchrophasor and POW data in real time.

42 ENGINEERING↗
DOE OSTI2017

Autopiquer - a Robust and Reliable Peak Detection Algorithm for Mass Spectrometry

We present a simple algorithm for robust and unsupervised peak detection by determining a noise threshold in isotopically resolved mass spectrometry data. Solving this problem will greatly reduce the subjective and time-consuming manual picking of mass spectral peaks and so will prove beneficial in many research applications. The Autopiquer approach uses autocorrelation to test for the presence of (isotopic) structure in overlapping windows across the spectrum. Within each window, a noise threshold is optimized to remove the most unstructured data, whilst keeping as much of the (isotopic) structure as possible. This algorithm has been successfully demonstrated for both peak detection and spectral compression on data from many different classes of mass spectrometer and for different sample types, and this approach should also be extendible to other types of data that contain regularly spaced discrete peaks. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Bayesian calibration of a physics-based crystal plasticity and damage model

In this work, we present a model parameter calibration procedure for a physics-based crystal plasticity model. The calibration process utilizes a powerful statistics-based Bayesian calibration method. Calibration of the crystal plasticity parameters makes use of experimentally-measured data, i.e. compressive stress–strain response, from $\langle$100$\rangle$ and $\langle$123$\rangle$ single crystal copper dynamically loaded via Kolsky bar tests. The calibration of damage parameters is achieved using experimentally-measured free-surface velocity history data from plate impact test on $\langle$100$\rangle$ and $\langle$110$\rangle$ single crystal copper, which generates shock compression followed by dynamic tensile failure. A validation assessment is then carried out by comparing the calibrated model predictions and experimental measurements of the dynamic tensile damage generated in an impacted bicrystal copper plate. Lastly, a model-informed rationale for the experimentally-observed dependence of the spatial distribution of ductile damage (porosity) on crystallography is provided.

42 ENGINEERING↗
DOE OSTI2017

Combinations of NIR, Raman spectroscopy and physicochemical measurements for improved monitoring of solvent extraction processes using hierarchical multivariate analysis models

The reliability of chemical processes can be greatly improved by implementing inline monitoring systems. Combining multivariate analysis with non-destructive sensors can enhance the process without interfering with the operation. Here, we present here hierarchical models using both principal component analysis and partial least square analysis developed for different chemical components representative of solvent extraction process streams. A training set of 380 samples and an external validation set of 95 samples were prepared and Near infrared and Raman spectral data as well as conductivity under variable temperature conditions were collected. The results from the models indicate that careful selection of the spectral range is important. By compressing the data through Principal Component Analysis (PCA), we lower the rank of the data set to its most dominant features while maintaining the key principal components to be used in the regression analysis. Within the studied data set, concentration of five chemical components were modeled; total nitrate (NO 3 - ), total acid (H + ), neodymium (Nd 3+ ), sodium (Na + ), and ionic strength (I.S.). The best overall model prediction for each of the species studied used a combined data set comprised of complementary techniques including NIR, Raman, and conductivity. Finally, our study shows that chemometric models are powerful but requires significant amount of carefully analyzed data to capture variations in the chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Scheduled Sequential Compressed Spectrum Sensing for Wideband Cognitive Radios

The support for high data rate applications with the cognitive radio technology necessitates wideband spectrum sensing. However, it is costly to apply long-term wideband sensing and is especially difficult in the presence of uncertainty, such as high noise, interference, outliers, and channel fading. In this paper, we propose scheduling of sequential compressed spectrum sensing which jointly exploits compressed sensing (CS) and sequential periodic detection techniques to achieve more accurate and timely wideband sensing. Instead of invoking CS to reconstruct the signal in each period, our proposed scheme performs backward grouped-compressed-data sequential probability ratio test (backward GCD-SPRT) using compressed data samples in sequential detection, while CS recovery is only pursued when needed. This method on one hand significantly reduces the CS recovery overhead, and on the other takes advantage of sequential detection to improve the sensing quality. Furthermore, we propose (a) an in-depth sensing scheme to accelerate sensing decision-making when a change in channel status is suspected, (b) a block-sparse CS reconstruction algorithm to exploit the block sparsity properties of wide spectrum, and (c) a set of schemes to fuse results from the recovered spectrum signals to further improve the overall sensing accuracy. Finally, extensive performance evaluation results show that our proposed schemes can significantly outperform peer schemes under sufficiently low SNR settings.

42 ENGINEERING↗
DOE OSTI2022

Argon equation of state data to 1 TPa: Shock compression experiments and simulations

Argon is the most abundant noble gas on Earth and its noble, atomic fluid nature makes it an excellent candidate for comparison of experiment and theory at extreme conditions. For this study, we performed a combined computational and experimental study on shock compressed cryogenic liquid argon. Using Sandia's Z machine, we shock compressed liquid argon to 600 GPa and reshock states up to 950 GPa. Laser shock experiments at the Omega Laser facility extend the principal Hugoniot to 1000 GPa and provided temperature data along the principal Hugoniot. The plate impact experiments and laser shock experiments used well-characterized impedance matching standards and demonstrate consistent results between the two platforms over a common range. Density functional theory based molecular dynamics simulations provided additional data on the Hugoniot to 600 GPa. The combined experimental data and simulation results provide constraints on the development of new equation of state models at extreme conditions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Delta-Rice: A HDF5 Compression Plugin optimized for Digitized Detector Data

Delta-Rice is an HDF5 (The HDF Group et al., 2020) filter plugin that was developed to compress digitized detector signals recorded by the Nab experiment (Fry et al., 2019), a fundamental neutron physics experiment. This is a two-step process where incoming data is passed through a pre-processing filter and then compressed with Rice coding. A routine for determining the optimal pre-processing filter for a dataset is provided along with an example GPU deployment. When applied to data collected by the Nab data acquisition system, this method produced output files 29% their initial size, and was able to do so with an average read/write throughput in excess of 2 GB/s on a single CPU. Compared to the widely used Gzip compression routine, Delta-Rice reduces the file size by 33% more with over an order of magnitude increase in read/write throughput. Delta-Rice is available on CPU to users through the HDF5 library.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

$\mathrm{UPDATED}$ $\mathrm{U3SI2}$ thermal creep model and sensitivity analysis of the $\mathrm{U3SI2-SIC}$ accident tolerant $\mathrm{FUEL}$

U 3 Si 2 is a candidate accident tolerant fuel (ATF) replacement for UO 2 . U 3 Si 2 ’s high uranium density and high thermal conductivity are favorable properties in steady-state and accident conditions. Low power performance of this U3Si2-SiC concept fuel is compared to that of UO 2 -Zr4 fuels by implementing models that describe the properties of U 3 Si 2 and SiC-SiC into Idaho National Laboratory's (INL) fuel performance code, BISON. Included in these material models is a thermal creep model for U 3 Si 2 based on compressive creep data. The simulated results are in keeping with community knowledge that the U 3 Si 2 -SiC concept fuel may serve as a replacement for UO 2 -Zr4 fuels during steady-state operation, provided the mSiC layer remains under compression. Through a moderate power history and three 24-month fuel cycles, the mSiC layer remains under compressive stress through a burnup of 80 MWd/kgU. During low power operation, failure of the mSiC layer generally occurs prior to significant thermal creep in U 3 Si 2 . Generally, U 3 Si 2 creep is temperature sensitive and of little importance at the temperatures and stresses simulated during steady operation and during fuel-to-cladding contact. A parameter variation study including 11,520 individual simulations with variations in nominal fuel thermal creep rate, cladding thermal conductivity, cladding irradiation creep and swelling, cladding gap size, and cladding thickness demonstrated that research priorities for this ATF should revolve around reducing cladding thickness as a means to minimize cladding failure. Generally, despite advances in SiC-SiC compliance, the brittle nature of mSiC excludes U 3 Si 2 -SiC for use where fuel cladding contact may occur.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2018

Feature identification or classification using task-specific metadata

Innovations in the identification or classification of features in a data set are described, such as a data set representing measurements taken by a scientific instrument. For example, a task-specific processing component, such as a video encoder, is used to generate task-specific metadata. When the data set includes video frames, metadata can include information regarding motion of image elements between frames, or other differences between frames. A feature of the data set, such as an event, can be identified or classified based on the metadata. For example, an event can be identified when metadata for one or more elements of the data set exceed one or more threshold values. When the feature is identified or classified, an output, such as a display or notification, can be generated. Although the metadata may be useable to generate a task-specific output, such as compressed video data, the identifying or classifying is not used solely in production of, or the creation of an association with, the task-specific output.

Teuton, Jeremy R.↗
DOE OSTI2020

Feature identification or classification using task-specific metadata

Innovations in the identification or classification of features in a data set are described, such as a data set representing measurements taken by a scientific instrument. For example, a task-specific processing component, such as a video encoder, is used to generate task-specific metadata. When the data set includes video frames, metadata can include information regarding motion of image elements between frames, or other differences between frames. A feature of the data set, such as an event, can be identified or classified based on the metadata. For example, an event can be identified when metadata for one or more elements of the data set exceed one or more threshold values. When the feature is identified or classified, an output, such as a display or notification, can be generated. Although the metadata may be useable to generate a task-specific output, such as compressed video data, the identifying or classifying is not used solely in production of, or the creation of an association with, the task-specific output.

Teuton, Jeremy R.↗
DOE OSTI2019

Variable Precision Computing

This report summarizes the activities and major accomplishments of the Variable Precision Computing Strategic Initiative project. The overarching goal of this project was to initiate and promote a new paradigm in High Performance Computing (HPC) that would fundamentally change how we represent and make use of representations of real numbers in finite precision and that would establish Lawrence Livermore National Laboratory (LLNL) as a leader in precision-related research for HPC. We pursued three integrated and concurrent research thrusts: new, more dynamic data representations to address data motion and capacity limitations; improved mixed precision algorithms to accelerate computation and to leverage new hardware; and new tools to help developers reason about precision and to automate code transformations. Within these thrust areas, we made significant advances in the use of compressed array data types in numerical calculations, in the theoretical justification, in improved performance, and in the prospects of hardware implementation; in the development of metrics to significantly reduce the storage needs of molecular dynamics simulations; in the development and analysis of efficient mixed-precision algorithms for time-dependent partial differential equations and for orthogonal factorization; and in the capability of tools that can analyze sensitivity of computed results to choices in precision and that can make automated code transformations based on such analysis. We established that there are definite opportunities to realize significant improvements in HPC above and beyond the 2x limits of traditional mixed precision using the technologies we have developed. The project produced numerous papers, presentations, and posters in important venues as well as open-source software contributions to the community, and many of the new capabilities have initiated or are being leveraged in ongoing projects.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Shockless compression and release behavior of beryllium to 110 GPa

A magnetohydrodynamic loading technique was used to shocklessly compress beryllium to peak longitudinal stresses of 19–110 GPa and, subsequently, unload in order to determine both the compressive response and also the shear stress supported upon release. Loading strain rates were on the order of 10{sup 6 }s{sup −1}, while the unloading rates were nearly constant at 3 × 10{sup 5 }s{sup −1}. Velocimetry was used to monitor the ramp and release behavior of a beryllium/lithium fluoride window interface. After applying window corrections to infer in situ beryllium velocities, a Lagrangian analysis was employed to determine the material response. The Lagrangian wavespeed-particle velocity response is integrated to generate the stress-strain path, average change in shear stress over the elastic unloading, and estimates of the shear modulus at peak compression. These data are used to infer the pressure dependence of the flow strength at the unloading rate. Comparisons to several strength models reveal good agreement to 45 GPa, but the data indicate 20%–30% higher strength near 100 GPa.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗