Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Quantifying the hierarchy of structural and mechanical length scales in granular systems

Continuum modeling of granular media is made possible by the existence of a length scale at and above which grain-resolved properties can be meaningfully homogenized. Progress has been made in identifying such length scales relevant to local structural properties such as porosity. However, a systematic analysis of scales above which different mechanical properties can be homogenized has yet to emerge. Here, X-ray tomography and 3D X-ray diffraction data are examined to identify such length scales. The data was obtained in-situ in compressed granular materials with rigid and flexible confinement. The experimental data are supplemented with validated discrete element simulations which examine different system sizes and different boundary conditions. Overall, our study reveals a hierarchy in the length scales of granular solids, with lengths governing structural variables being the shortest, lengths of stress variables being intermediate, and lengths of energy dissipation being the longest. All structural and mechanical length scales obey a power law based on the theory of Geostatistics, implying that the length scales can be found by analyzing samples significantly smaller than the length scales themselves. The length scales are also found to be sensitive to boundary conditions, implying that they are extrinsic features of granular media.

36 MATERIALS SCIENCE↗

Fallon FORGE: Analogue Outcrop Samples

Compilation of results for mechanical and fluid flow properties of analogue outcrop samples - experimental data for compressional and shear wave velocities, tensile strengths, and compressive strengths. Outcrop location and sample orientation data are documented in a separate csv file.

15 GEOTHERMAL ENERGY↗

A Survey on Error-Bounded Lossy Compression for Scientific Datasets

Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide range of parallel and distributed use cases for years. They are designed with distinct compression models and principles, such that each of them features particular pros and cons. In this article, we provide a comprehensive survey of emerging error-bounded lossy compression techniques. The key contribution is fourfold. (1) We summarize a novel taxonomy of lossy compression into six classic models. (2) We provide a comprehensive survey of 10 commonly used compression components/modules. (3) We summarized pros and cons of 47 state-of-the-art lossy compressors and present how state-of-the-art compressors are designed based on different compression techniques. (4) We discuss how customized compressors are designed for specific scientific applications and use-cases. We believe this survey is useful to multiple communities including scientific applications, high-performance computing, lossy compression, and big data.

Error-Bounded Lossy Compression↗

Lifetime Extension Report: Progress on the SAVY-4000 Lifetime Extension Program

The 3-year accelerated aging study of the SAVY-4000 O-ring shows very little evidence of significant degradation to samples subjected to aggressive elevated temperature and radiation conditions. Whole container thermal aging studies followed by helium leakage testing and compression set measurements were used to establish an estimate for a failure criterion for O-ring compression set of ≥65 %. The whole container aging studies further show that the air flow and efficiency functions of the filter do not degrade significantly after thermal aging. However, the degradation of the water-resistant function leads to water penetration failure after four months at 210°C, but does not cause failure after 10 months at 120°C (130°C is the maximum operating temperature for the PTFE membrane). The thermal aging data for O-ring compression set do not meet the assumptions of standard time-temperature superposition analysis for accelerated aging studies. Instead, the data suggest that multiple degradation mechanisms are operative, with a reversible mechanism operative at low aging temperatures and an irreversible mechanism dominating at high aging temperatures. To distinguish between these mechanisms, we have measured compression set after allowing the sample to physically relax, thereby minimizing the effect of the reversible mechanism. The resulting data were analyzed using two distinct mathematical methods to obtain a lifetime estimate based on chemical degradation alone. Both methods support a lifetime estimate of greater than 150 years at 80°C. Although the role of the reversible mechanism is not fully understood, it is clear that the contribution to the total compression set is small in comparison to that due to the chemical degradation mechanism. To better understand the chemical degradation mechanism, thermally aged O-ring samples have been characterized by Fourier Transform Infrared (FTIR), Electron Paramagnetic Resonance (EPR), Gel Permeation Chromatography (GPC), and Differential Scanning Calorimetry (DSC). These experiments detect no significant O-ring degradation below 80°C. Furthermore, durometer measurements indicate that there is no significant change in O-ring hardness at all aging conditions examined. Therefore, our current conservative lifetime estimate for the O-ring and the filter is 10 years at 80°C. In FY17, we will continue to probe the chemical degradation mechanism using oxygen consumption measurements under accelerated aging conditions to reveal temperatures at which oxidation occurs, along with any differences in oxidation rate at the low vs. high aging temperatures. We will also refine the failure criteria and finalize the radiation/thermal synergistic studies to determine a final design lifetime.

42 ENGINEERING↗

GPU-based Image Compression for Efficient Compositing in Distributed Rendering Applications

Visualizations of large-scale data sets are often created on graphics clusters that distribute the rendering task amongst many processes. When using real-time GPU-based graphics algorithms, the most time-consuming aspect of distributed rendering is typically the com-positing phase - combining all partial images from each rendering process into the final visualization. Compo siting requires image data to be copied off the GPU and sent over a network to other processes. While compression has been utilized in existing distributed rendering compositors to reduce the data being sent over the network, this compression tends to occur after the raw images are transferred from the GPU to main memory. In this paper, we present work that leverages OpenGL / CUDA interoperability to compress raw images on the GPU prior to transferring the data to main memory. This approach can significantly reduce the device-to-host data transfer time, thus enabling more efficient compositing of images generated by distributed rendering applications.

Lipinksi, Riley↗

Compression Algorithm Analysis of In-Situ (S)TEM Video: Towards Automatic Event Detection and Characterization

Precise analysis of both (S)TEM images and video are time and labor intensive processes. As an example, determining when crystal growth and shrinkage occurs during the dynamic process of Li dendrite deposition and stripping involves manually scanning through each frame in the video to extract a specific set of frames/images. For large numbers of images, this process can be very time consuming, so a fast and accurate automated method is desirable. Given this need, we developed software that uses analysis of video compression statistics for detecting and characterizing events in large data sets. This software works by converting the data into a series of images which it compresses into an MPEG-2 video using the open source “avconv” utility [1]. The software does not use the video itself, but rather analyzes the video statistics from the first pass of the video encoding that avconv records in the log file. This file contains statistics for each frame of the video including the frame quality, intra-texture and predicted texture bits, forward and backward motion vector resolution, among others. In all, avconv records 15 statistics for each frame. By combining different statistics, we have been able to detect events in various types of data. We have developed an interactive tool for exploring the data and the statistics that aids the analyst in selecting useful statistics for each analysis. Going forward, an algorithm for detecting and possibly describing events automatically can be written based on statistic(s) for each data type.

algorithm analysis↗

Approximate Bayesian computation for forward modeling in cosmology

Bayesian inference is often used in cosmology and astrophysics to derive constraints on model parameters from observations. This approach relies on the ability to compute the likelihood of the data given a choice of model parameters. In many practical situations, the likelihood function may however be unavailable or intractable due to non-gaussian errors, non-linear measurements processes, or complex data formats such as catalogs and maps. In these cases, the simulation of mock data sets can often be made through forward modeling. We discuss how Approximate Bayesian Computation (ABC) can be used in these cases to derive an approximation to the posterior constraints using simulated data sets. This technique relies on the sampling of the parameter set, a distance metric to quantify the difference between the observation and the simulations and summary statistics to compress the information in the data. We first review the principles of ABC and discuss its implementation using a Population Monte-Carlo (PMC) algorithm and the Mahalanobis distance metric. We test the performance of the implementation using a Gaussian toy model. We then apply the ABC technique to the practical case of the calibration of image simulations for wide field cosmological surveys. We find that the ABC analysis is able to provide reliable parameter constraints for this problem and is therefore a promising technique for other applications in cosmology and astrophysics. Our implementation of the ABC PMC method is made available via a public code release.

79 ASTRONOMY AND ASTROPHYSICS↗

The Coal-Seq III Consortium. Advancing the Science of CO 2 Sequestration in Coal Seam and Gas Shale Reservoirs

The Coal-Seq consortium is a government-industry collaborative that was initially launched in 2000 as a U.S. Department of Energy sponsored investigation into CO2 sequestration in deep, unmineable coal seams. The consortium’s objective aimed to advancing industry’s understanding of complex coalbed methane and gas shale reservoir behavior in the presence of multi-component gases via laboratory experiments, theoretical model development and field validation studies. Research from this collaborative effort was utilized to produce modules to enhance reservoir simulation and modeling capabilities to assess the technical and economic potential for CO2 storage and enhanced coalbed methane recovery in coal basins. Coal-Seq Phase 3 expands upon the learnings garnered from Phase 1 & 2, which has led to further investigation into refined model development related to multicomponent equations-of-state, sorption and diffusion behavior, geomechanical and permeability studies, technical and economic feasibility studies for major international coal basins the extension of the work to gas shale reservoirs, and continued global technology exchange. The first research objective assesses changes in coal and shale properties with exposure to CO2 under field replicated conditions. Results indicate that no significant weakening occurs when coal and shale were exposed to CO2, therefore, there was no need to account for mechanical weakening of coal due to the injection of CO2 for modeling. The second major research objective evaluates cleat, Cp, and matrix, Cm, swelling/shrinkage compressibility under field replicated conditions. The experimental studies found that both Cp and Cm vary due to changes in reservoir pressure during injection and depletion under field replicated conditions. Using laboratory data from this study, a compressibility model was developed to predict the pore-volume compressibility, Cp, and the matrix compressibility, Cm, of coal and shale, which was applied to modeling software to enhance model robustness. Research was also conducted to improve algorithms and generalized adsorption models to facilitate realistic simulation of CO2 sequestration in coal seams and shale gas reservoirs. The interaction among water and the adsorbed gases, carbon dioxide (CO2), methane (CH4), and nitrogen (N2) in coalbeds is examined using experimental in situ laboratory techniques to comprehensively model CBM production and CO2 sequestration in coals. An equation of state (EOS) module was developed which is capable of predicting the density of pure components and mixtures involving the wet CBM gases CH4, CO2, and N2 at typical reservoir condition, and is used to inform CO2 injection models. The final research objective examined the effects adsorbed CO2 has on coal strength and permeability. This research studied the weakening or failure of coal by the adsorption of CO2 from empirically derived gas production data to develop models for advanced modeling of permeability changes during CO2 sequestration. The results of this research effort have been used to construct a new and improved model for assessing changes in permeability of coal reservoirs due CO2 injection. The modules developed from these studies and knowledge learned are applied to field validation and basin assessment studies. These data were used to assess the flow and storage of CO2 in a shale reservoir, test newly developed code against large-scale projects, and conduct a basin-oriented review of coal storage potential in the San Juan Basin. The storage potential and flow of CO2 was modeled for shale sequestration of a proprietary Marcellus Shale horizontal gas production well using COMET3 simulation software. Simulation results from five model runs indicate that stored CO2 quantities are linked to the duration of primary production preceding injection. Matrix CO2 saturation is observed to increase in each shale zone after injection with an increase in primary production, and the size of the CO2 plume is also observed to increase in size the longer initial production is sustained. The simulation modules developed around the Coal-Seq experimental work are also incorporated into a pre-existing large-scale numerical simulation model of the Pump Canyon CO2-ECBM pilot in the San Juan Basin. The new model was applied to re-history match the data set to explore the improvements made in permeability prediction against previously published data sets and to validate this module. The assessment of the new data, however, indicates that the impact of the variable Cp is negligible on the overall behavior of the coal for CO2 storage purposes. Applying these new modules, the San Juan Basin and the Marcellus Shale are assessed for their technical ECBM/AGR and CO2 storage potential and the economic potential of these operations. The San Juan Basin was divided into 4 unique geographic zones based on production history, and the Marcellus was divided into nine. Each was assessed based upon each zone’s properties, and simulations were run to assess the potential of full Basin development. Models of a fully developed San Juan Basin suggest the potential for up to 104 Tcf of CO2 storage, and 12.3 Tcf of methane recovery. The Marcellus models suggest 1,248 Tcf of CO2 storage and 924 Tcf of AGR. The economics are deemed favorable where credits cover the cost of CO2 in the San Juan Basin, and in many cases in the Marcellus, but to maximize storage potential, credits need to extend to pay the operator to store CO2.

01 COAL, LIGNITE, AND PEAT↗

Investigation of fast and efficient lossless compression algorithms for macromolecular crystallography experiments

Structural biology experiments benefit significantly from state-of-the-art synchrotron data collection. One can acquire macromolecular crystallography (MX) diffraction data on large-area photon-counting pixel-array detectors at framing rates exceeding 1000 frames per second, using 200 Gbps network connectivity, or higher when available. In extreme cases this represents a raw data throughput of about 25 GB s −1 , which is nearly impossible to deliver at reasonable cost without compression. Our field has used lossless compression for decades to make such data collection manageable. Many MX beamlines are now fitted with DECTRIS Eiger detectors, all of which are delivered with optimized compression algorithms by default, and they perform well with current framing rates and typical diffraction data. However, better lossless compression algorithms have been developed and are now available to the research community. Here one of the latest and most promising lossless compression algorithms is investigated on a variety of diffraction data like those routinely acquired at state-of-the-art MX beamlines.

36 MATERIALS SCIENCE↗

Measurement of the sound speed in dense fluid deuterium along the cryogenic liquid Hugoniot

Many experimental studies, spanning several decades of research and using various dynamic compression schemes, have been conducted to investigate cryogenic liquid deuterium under strong shock compression. The consensus emerging from these studies is that of a progressive dissociation of the D 2 molecules into an electrically conducting, atomic plasma, when subjected to shock pressures exceeding ~50 GPa. While state-of-the-art numerical simulations based on density-functional-theory or quantum Monte-Carlo techniques capture this behavior quite well, subtle differences subsist between these simulations and the available experimental data regarding the pressure-density compressibility. Here, leveraging a recently developed analysis method for high-resolution Doppler interferometric velocity data, we present Eulerian sound speed measurements in compressed deuterium to shock pressures between 50 and 200 GPa. These results, extracted from laser-driven shockwave experiments, are found to agree with several of the most accurate equation of state models for deuterium at those conditions up to ~150 GPa. However, the data indicate that these models fail to reproduce the experimentally observed sound speed at higher pressures, approaching 200 GPa. In particular, we unveil a discrepancy between the experimental results and the equation of state model that is most commonly used in inertial confinement fusion at the National Ignition Facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Cosmological constraints from a joint DESI DR1 Full-Shape and DR2 BAO

We present a cosmological analysis combining full-shape (FS) clustering measurements from the Dark Energy Spectroscopic Instrument (DESI) DR1 with baryon acoustic oscillation (BAO) measurements from DESI DR2. To achieve a robust combination that accounts for the correlation between the two data releases, we employ the ShapeFit compression method and estimate the joint covariance using EZmocks. This compressed approach inherently mitigates the prior volume effects that have previously dominated Bayesian constraints from DESI data with minimal external priors. Consequently, we obtain — for the first time within a Bayesian framework — reliable DESI-only constraints on extensions to ΛCDM using only a Big Bang Nucleosynthesis prior on the baryon density and a wide prior on the spectral index. In flat ΛCDM, we find Ω m = 0.3035 ± 0.0085, h = 0.6876 ± 0.0059, and σ 8 = 0.822 ± 0.034. For the w 0 w a CDM dynamical dark energy model, we measure w 0 = -0.49 ± 0.25 and w a = -1.52 ± 0.77, improving constraints by ∼ 30% relative to the analogous DR1 measurement and reducing the discrepancy with ΛCDM to 1.4σ when compared to BAO only analyses. We also report competitive limits on the sum of neutrino masses and spatial curvature. This work demonstrates that the ShapeFit compression provides a prior-robust and computationally efficient pathway to constrain beyond-ΛCDM physics with large-scale structure.

baryon acoustic oscillations↗

HP-MDR: High-performance and Portable Data Refactoring and Progressive Retrieval with Advanced GPUs

Scientific applications produce vast amounts of data, posing grand challenges in the underlying data management and analytic tasks. Progressive compression is a promising way to address this problem, as it allows for on-demand data retrieval with significantly reduced data movement cost. However, most existing progressive methods are designed for CPUs, leaving a gap for them to unleash the power of today’s heterogeneous computing systems with GPUs.In this work, we propose HP-MDR, a high-performance and portable data refactoring and progressive retrieval framework for GPUs. Our contributions are four-fold: (1) We carefully optimize the bitplane encoding and lossless encoding, two key stages in progressive methods, to achieve high performance on GPUs; (2) We propose pipeline optimization and incorporate it with data refactoring and progressive retrieval workflows to further enhance the performance for large data process; (3) We leverage our framework to enable high-performance data retrieval with guaranteed error control for common Quantities of Interest; (4) We evaluate HP-MDR and compare it with state of the arts using five real-world datasets. Experimental results demonstrate that HP-MDR delivers an average 13.68 × and 6.31 × throughput in data refactoring and progressive retrieval tasks, respectively. It also leads to 11.22 × throughput for recomposing required data representations under Quantity-of-Interest error control and 6.04 × performance for the corresponding end-to-end data retrieval, when compared with state-of-the-art solutions.

Li, Yanliang [University of Oregon]↗

Compression dynamics of quasi-spherical wire arrays with different linear mass profiles

Results of experimental studies of the implosion of quasi-spherical wire (or metalized fiber) arrays are presented. The goal of the experiments was to achieve synchronous three-dimensional compression of the plasma produced in different regions of a quasi-spherical array into its geometrical center. To search for optimal synchronization conditions, quasi-spherical arrays with different initial profiles of the linear mass were used. The following dependences of the linear mass on the poloidal angle were used: m{sub l}(θ) ∝ sin{sup –1}θ and m{sub l}(θ) ∝ sin{sup –2}θ. The compression dynamics of such arrays was compared with that of quasi-spherical arrays without linear mass profiling, m{sub l}(θ) = const. To verify the experimental data, the spatiotemporal dynamics of plasma compression in quasi-spherical arrays was studied using various diagnostics. The experiments on three-dimensional implosion of quasi-spherical arrays made it possible to study how the frozen-in magnetic field of the discharge current penetrates into the array. By measuring the magnetic field in the plasma of a quasi-spherical array, information is obtained on the processes of plasma production and formation of plasma flows from the wire/fiber regions with and without an additionally deposited mass. It is found that penetration of the magnetic flux depends on the initial linear mass profile m{sub l}(θ) of the quasi-spherical array. From space-resolved spectral measurements and frame imaging of plasma X-ray emission, information is obtained on the dimensions and shape of the X-ray source formed during the implosion of a quasi-spherical array. The intensity of this source is estimated and compared with that of the Z-pinch formed during the implosion of a cylindrical array.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Acoustical, morphological and optical properties of oral rehydration salts (ORS)

Ultrasonic velocity, density and viscosity were measured in different concentrations of oral rehydration salts (ORS) at room temperature 303 k. From the experimental data other related thermodynamic parameters, viz adiabatic compressibility, intermolecular free length, acoustic impedence, relaxation time are calculated. The experimental data were discussed in the light of molecular interaction existing in the liquid mixtures. The results have been discussed in terms of solute-solvent interaction between the components. Structural characterization is important for development of new material. The morphology, structure and grain size of the samples are investigated by SEM. The optical properties of the sample have been studied using UV Visible spectroscopy.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Shock compression of liquid helium to 360 GPa

Data for the shock equation of state of helium are obtained up to 360⁢G⁡Pa, nearly doubling the pressure of previous experimental measurements. The helium samples are first precompressed to 2.7 g⁡c⁢m −3 in a diamond anvil cell prior to laser-driven shock compression at the Omega Laser Facility. Time-resolved Doppler velocimetry and pyrometry reveal significant reflectivity and greater compressibility compared to the predictions of existing broad-range tabular equation of state models, which may be caused by the onset of ionization. These experimental observations, however, are largely captured with molecular-dynamics simulations based on density functional theory, affirming the ability of first-principles techniques to capture complex physics, while enabling critical insight for the behavior of warm dense helium in Jovian interiors and white dwarf atmospheres.

Physics - Plasma physics↗

Initial Testing of an In Situ Load Retention Aging Vessel

A thermal aging vessel instrumented with load cells was fabricated. The primary function of the vessel is to continuously monitor the in situ load retention of up to three compressed polymer coupons undergoing thermally accelerated aging under nitrogen. A secondary function is to enable gas sampling of the vessel headspace during thermal aging. Heating of the vessel is achieved using a custom heater jacket. To improve upon our conventional aging study methods which require periodic interruption of aging to perform load testing in an Instron machine at room temperature, this technology aims to automate/facilitate data acquisition/analysis, improve data quality, and enable uninterrupted compression of the polymer which represents the service condition. As an example case to assess functionality of the in situ vessel, the load retention of a siloxane elastomer material additively manufactured by direct-ink-writing (DIW) was measured at three different isothermal aging temperatures for ~1 month. Initial compression of the coupons while near the aging temperature was achieved by temporarily opening the heated vessel to access the interior chamber and manually tightening four nuts to drive the heated compression plate down onto the heated coupons. Initial testing demonstrated achievement of the primary load retention monitoring function. Unfortunately, the vessel leaked which prevented gas sampling; an active purge was used to maintain a nitrogen atmosphere. Welded or otherwise sealed joints, which could be implemented in a future design, would likely eliminate leak paths. To apply time-temperature superposition (TTS), a technique used to provide long-term prediction of the load retention from short-term isothermal data, the load retention needed to be calculated relative to the load at an estimated “equilibrium” time, after most of the transient viscoelastic physical relaxation occurred. The peak load immediately after compression could not be used as the load retention basis for two reasons: (1) age-related changes must be isolated from non-age-related physical relaxation before applying TTS and (2) the manual mechanism used to compress the specimens at the aging temperature was neither smooth nor repeatable which affected the peak load value. To better understand the effect of the mode of initial compression on the measured load, and possibly better estimate “equilibrium” physical relaxation times, systematic stress relaxation experiments were performed using an Instron machine with a thermal chamber. At a given temperature, the DIW polymer was compressed to a fixed strain in either a stepped or continuous manner at two different rates, then held at that strain for 24 hrs. The results indicated that, at a given temperature, the different stress relaxation curves appeared to converge to the same curve at some “equilibrium” time when the non-age-related physical relaxation was mostly complete. Though this observation suggests that the discontinuous manual compression employed by the vessel is feasible, a compression mechanism that is rapid, smooth, and repeatable would enhance its use.

36 MATERIALS SCIENCE↗

Load Deflection Data (LDDATA)

The current data set is load deflection data (Stress vs strain for compression stress and stress vs elongation for tension stress) from a material test. The goal of the test was to characterize this rubber-like material by looking at different variables: sample creation process, anisotropy, temperature, etc. The data will be used with the Texas A&M Online Research Experience for Undergraduates (O-REU) program. This program is joint with LANL. The student is not an official LANL student so they will not be able to access data and documents on the yellow. The load deflection data set is unclassified and will be sent to the student for analysis. Analysis will include curve fitting, scalar value analysis (stiffness, toughness, etc.) and analysis of variance to determine what variables statistically affect the response while correcting for covariates (temperature soak time and humidity). Data will be stored as Matlab structs and as HDF5 files. Same data, different formats.

36 MATERIALS SCIENCE↗

Synthetic Streamflow Datasets to Support Emulation of Water Allocations via LSTM

This archive is the data companion to the bonney_et-al_2026_erc metarepo which generates synthetic data, trains an LSTM model, and generates performance metrics on the trained model. While the generation of the synthetic data is fully reprodicible, it is a computationally expensive process. This data archive contains the synthetic datasets needed for training and testing an LSTM model and reproduction of figures and tables. In addition, supplemenatary data products generating and visualizing results is also included, such as geospatial data for the basin. Contents There are two high level directories: `WRAP_archive/` and `repo_data/`. The `WRAP_archive` directory contains compressed intermediate dataproducts from the dataset generation workflow (marked as "I_Dataset_Generation" in the metarepo). These data products are not required by any scripts in the metarepo, but they are archived as they are expensive to generate and may have useful information for other analyses. The `repo_data` directory contains the necessary data for reproducing the workflow in the metarepo and should be decompressed and moved into the top level of the metarepo. Additional details are provided in README.md.

drought↗