Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data compression techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Physics-Driven Convolutional Autoencoder Approach for CFD Data Compressions: Preprint

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been proposed and shown to be effective at producing reduced representations of turbulent flow data. However, these approaches focus solely on training the model using point-wise sample reconstruction losses that do not take advantage of the physical properties of turbulent flows. In this paper, we show that training autoencoders with additional physics-informed regularizations, e.g., enforcing incompressibility and preserving enstrophy, improves the compression model in three ways: (i) the compressed data better conform to known physics for homogeneous isotropic turbulence without negatively impacting point-wise reconstruction quality, (ii) inspection of the gradients of the trained model uncovers changes to the learned compression mapping that can facilitate the use of explainability techniques, and (iii) as a performance byproduct, training losses are shown to converge up to 12x faster than the baseline model.

auto-encoders↗

Simultaneous compression and opacity data from time-series radiography with a Lagrangian marker

Time-resolved radiography can be used to obtain absolute shock Hugoniot states by simultaneously measuring at least two mechanical parameters of the shock, and this technique is particularly suitable for one-dimensional converging shocks where a single experiment probes a range of pressures as the converging shock strengthens. However, at sufficiently high pressures, the shocked material becomes hot enough that the x-ray opacity falls significantly. Additionally, if the system includes a Lagrangian marker such that the mass within the marker is known, this additional information can be used to constrain the opacity as well as the Hugoniot state. In the limit that the opacity changes only on shock heating, and not significantly on subsequent isentropic compression, the opacity of the shocked material can be determined uniquely. More generally, it is necessary to assume the form of the variation of opacity with isentropic compression or to introduce multiple marker layers. Alternatively, assuming either the equation of state or the opacity, the presence of a marker layer in such experiments enables the non-assumed property to be deduced more accurately than from the radiographic density reconstruction alone. An example analysis is shown for measurements of a converging shock wave in polystyrene at the National Ignition Facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Efficient Clustering of Software Vulnerabilities using Self Organizing Map (SOM)

The common vulnerabilities and exposures (CVE) database was created with a mission to ``identify, define, and catalog publicly disclosed cybersecurity vulnerabilities''. This rich body of information can be used to enable rapid and efficient response to secure and defend cyber operations and protect critical cyber infrastructure. The main goal of this paper is to develop a visual analytics tool to enable deep analysis of CVEs using unsupervised clustering techniques. We enhance our analysis by first mapping CVEs to hierarchical-classes in Common Weakness Enumeration (CWE) using information in the National Vulnerability Database (NVD). Both the mapping and the numerical representation of CVEs are enabled by V2W-BERT, which uses natural language processing of the extensive information in NVD to generate a large tabular database of 137,226 CVE entries from 1999 to 2020, where each CVE is represented by a vector of 768 numerical features. The vectorized data is processed by Self-Organizing Maps (SOM), which is an unsupervised machine learning technique for dimensionality reduction, visual representation and clustering. Using a Torus map of 6417 units, we achieve ~10-fold data compression of ~140k CVEs using SOM. The trained map is further clustered using standard K-means clustering into 138 clusters of CVEs. We conducted a brief investigation of the rich mapping of CVEs to best-matching-units to K-means clusters, as well as CVEs to CWEs. For example, this novel mapping provided insight into the role of CWE-59 and CWE-264 in several CVEs that is otherwise hard to explore in the original data. We conclude that our this novel approach will not only enable deep analysis of the complex relationships between CVEs and CWEs, but also a mechanism to quickly respond to and design mitigation actions for rapidly evolving vulnerabilities that have not been mapped to existing CWEs.

Panchal, Khyati↗

A Novel Deep Reinforcement Learning Approach to Traffic Signal Control with Connected Vehicles

The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system’s model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density.

42 ENGINEERING↗

Concurrent measurement of strain and chemical reaction rates in a calcite grain pack undergoing pressure solution: Evidence for surface-reaction controlled dissolution

Pressure solution is inferred to be a significant contributor to sediment compaction and lithification, especially in carbonate sediments. For a sediment deforming primarily by pressure solution, the compaction rate should be directly related to the rate of calcite dissolution, transport along grain contacts, and calcite reprecipitation. Previous experimental work has shown that there is evidence that deformation in wet calcite grain packs is consistent with control by pressure solution, but considerable ambiguity remains regarding the rate limiting mechanism. We present the results of laboratory compaction experiments designed to directly measure calcite dissolution and precipitation rates (recrystallization rates) concurrently with strain rate to test whether measured rates are consistent with predicted rates both in absolute magnitude and time evolution. Recrystallization rates are measured using trace element chemistry (Sr/Ca, Mg/Ca) and isotopes (87Sr/86Sr) of fluids flowing slowly through a compacting grain pack as it is being triaxially compressed. Imaging techniques are used to characterize the grain contacts and strain effects in the post-experiment grain pack. Our data show that calcite recrystallization rates calculated from all three geochemical parameters are in approximate agreement and that the rates closely track strain rate. The geochemically inferred rates are close to predicted rates in absolute magnitude. Uncertainty in grain contact dimensions makes distinguishing between surface reaction control and diffusion control difficult. Measured reaction rates decrease faster than predicted from standard pressure solution creep flow laws. This inconsistency may indicate that calcite dissolution rates at grain contacts are more complex, and more time-dependent, than suggested by geometric models designed to predict grain contact stresses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accelerating Ultrafast Spectroscopy with Compressive Sensing

We report ultrafast spectroscopy is an important tool for studying photoinduced dynamical processes in atoms, molecules, and nanostructures. Typically, the time to perform these experiments ranges from several minutes to hours depending on the choice of spectroscopic method. It is desirable to reduce this time overhead not only to shorten time and laboratory resources, but also to make it possible to examine fragile specimens that quickly degrade during long experiments. In this article, we motivate using compressive sensing to significantly shorten data acquisition time by reducing the total number of measurements in ultrafast spectroscopy. We apply this technique to experimental data from ultrafast transient absorption spectroscopy and ultrafast terahertz spectroscopy and show that good estimates can be obtained with as low as 15% of the total measurements, implying a sixfold reduction in the data acquisition time.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Analysis of Compressibility Effects and Nonlinear Property Variations in a Supercritical CO2 Mixing Layer

Calculations are performed using the large eddy simulation technique to qualitatively assess the effects of fluid compressibility and thermodynamic nonlinearities on the dynamics of a supercritical flow field. Resulting data are also used to interrogate instantaneous subfilter-scale fields, as modeled by the mixed-dynamic Smagorinsky closure and gradient diffusion model. A three-dimensional wall-resolved calculation of a spatially evolving mixing layer composed solely of carbon dioxide is performed. This is followed by a coarse grid calculation to examine model performance as a function of resolution. Theoretical analysis indicates that the partial derivatives of density with respect to pressure and temperature are important modulators of the temperature and pressure field evolution, respectively. Results pertaining to subfilter velocity-velocity and velocity-temperature fields indicate that the models are most stressed in the regions where compressibility and thermo-fluid nonlinearities dominate the physics.

42 ENGINEERING↗

DeepAdversaries: examining the robustness of deep learning models for galaxy morphology classification

With increased adoption of supervised deep learning methods for work with cosmological survey data, the assessment of data perturbation effects (that can naturally occur in the data processing and analysis pipelines) and the development of methods that increase model robustness are increasingly important. In the context of morphological classification of galaxies, we study the effects of perturbations in imaging data. In particular, we examine the consequences of using neural networks when training on baseline data and testing on perturbed data. We consider perturbations associated with two primary sources: (a) increased observational noise as represented by higher levels of Poisson noise and (b) data processing noise incurred by steps such as image compression or telescope errors as represented by one-pixel adversarial attacks. We also test the efficacy of domain adaptation techniques in mitigating the perturbation-driven errors. We use classification accuracy, latent space visualizations, and latent space distance to assess model robustness in the face of these perturbations. For deep learning models without domain adaptation, we find that processing pixel-level errors easily flip the classification into an incorrect class and that higher observational noise makes the model trained on low-noise data unable to classify galaxy morphologies. On the other hand, we show that training with domain adaptation improves model robustness and mitigates the effects of these perturbations, improving the classification accuracy up to 23% on data with higher observational noise. Domain adaptation also increases up to a factor of ${\approx}2.3$ the latent space distance between the baseline and the incorrectly classified one-pixel perturbed image, making the model more robust to inadvertent perturbations. Successful development and implementation of methods that increase model robustness in astronomical survey pipelines will help pave the way for many more uses of deep learning for astronomy.

79 ASTRONOMY AND ASTROPHYSICS↗

A Survey on Error-Bounded Lossy Compression for Scientific Datasets

Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide range of parallel and distributed use cases for years. They are designed with distinct compression models and principles, such that each of them features particular pros and cons. In this article, we provide a comprehensive survey of emerging error-bounded lossy compression techniques. The key contribution is fourfold. (1) We summarize a novel taxonomy of lossy compression into six classic models. (2) We provide a comprehensive survey of 10 commonly used compression components/modules. (3) We summarized pros and cons of 47 state-of-the-art lossy compressors and present how state-of-the-art compressors are designed based on different compression techniques. (4) We discuss how customized compressors are designed for specific scientific applications and use-cases. We believe this survey is useful to multiple communities including scientific applications, high-performance computing, lossy compression, and big data.

Error-Bounded Lossy Compression↗

Initial Testing of an In Situ Load Retention Aging Vessel

A thermal aging vessel instrumented with load cells was fabricated. The primary function of the vessel is to continuously monitor the in situ load retention of up to three compressed polymer coupons undergoing thermally accelerated aging under nitrogen. A secondary function is to enable gas sampling of the vessel headspace during thermal aging. Heating of the vessel is achieved using a custom heater jacket. To improve upon our conventional aging study methods which require periodic interruption of aging to perform load testing in an Instron machine at room temperature, this technology aims to automate/facilitate data acquisition/analysis, improve data quality, and enable uninterrupted compression of the polymer which represents the service condition. As an example case to assess functionality of the in situ vessel, the load retention of a siloxane elastomer material additively manufactured by direct-ink-writing (DIW) was measured at three different isothermal aging temperatures for ~1 month. Initial compression of the coupons while near the aging temperature was achieved by temporarily opening the heated vessel to access the interior chamber and manually tightening four nuts to drive the heated compression plate down onto the heated coupons. Initial testing demonstrated achievement of the primary load retention monitoring function. Unfortunately, the vessel leaked which prevented gas sampling; an active purge was used to maintain a nitrogen atmosphere. Welded or otherwise sealed joints, which could be implemented in a future design, would likely eliminate leak paths. To apply time-temperature superposition (TTS), a technique used to provide long-term prediction of the load retention from short-term isothermal data, the load retention needed to be calculated relative to the load at an estimated “equilibrium” time, after most of the transient viscoelastic physical relaxation occurred. The peak load immediately after compression could not be used as the load retention basis for two reasons: (1) age-related changes must be isolated from non-age-related physical relaxation before applying TTS and (2) the manual mechanism used to compress the specimens at the aging temperature was neither smooth nor repeatable which affected the peak load value. To better understand the effect of the mode of initial compression on the measured load, and possibly better estimate “equilibrium” physical relaxation times, systematic stress relaxation experiments were performed using an Instron machine with a thermal chamber. At a given temperature, the DIW polymer was compressed to a fixed strain in either a stepped or continuous manner at two different rates, then held at that strain for 24 hrs. The results indicated that, at a given temperature, the different stress relaxation curves appeared to converge to the same curve at some “equilibrium” time when the non-age-related physical relaxation was mostly complete. Though this observation suggests that the discontinuous manual compression employed by the vessel is feasible, a compression mechanism that is rapid, smooth, and repeatable would enhance its use.

36 MATERIALS SCIENCE↗

Knowledge Distillation for Anomaly Detection

Unsupervised deep learning techniques are widely used to identify anomalous behaviour. The performance of such methods is a product of the amount of training data and the model size. However, the size is often a limiting factor for the deployment on resource-constrained devices. Here, we present a novel procedure based on knowledge distillation for compressing an unsupervised anomaly detection model into a supervised deployable one and we suggest a set of techniques to improve the detection sensitivity. Compressed models perform comparably to their larger counterparts while significantly reducing the size and memory footprint.

Pol, Adrian Alan↗

Robustness of deep learning algorithms in astronomy -- galaxy morphology studies

Deep learning models are being increasingly adopted in wide array of scientific domains, especially to handle high-dimensionality and volume of the scientific data. However, these models tend to be brittle due to their complexity and overparametrization, especially to the inadvertent adversarial perturbations that can appear due to common image processing such as compression or blurring that are often seen with real scientific data. It is crucial to understand this brittleness and develop models robust to these adversarial perturbations. To this end, we study the effect of observational noise from the exposure time, as well as the worst case scenario of a one-pixel attack as a proxy for compression or telescope errors on performance of ResNet18 trained to distinguish between galaxies of different morphologies in LSST mock data. We also explore how domain adaptation techniques can help improve model robustness in case of this type of naturally occurring attacks and help scientists build more trustworthy and stable models.

79 ASTRONOMY AND ASTROPHYSICS↗

$S$ Hmax orientation in the Alpine region from observations of stress-induced anisotropy of nonlinear elasticity

The orientation of $S$ Hmax is commonly estimated from in situ borehole breakouts and earthquake focal mechanisms. Borehole measurements are expensive, and therefore sparse, and earthquake measurements can only be made in regions with many well-characterized earthquakes. Here, we derive the stress-field orientation using stress-induced anisotropy in nonlinear elasticity. In this method, we measure the strain derivative of velocity as a function of azimuth. We use a natural pump-probe (NPP) approach which consists of measuring elastic wave speed using empirical Green’s functions (probe) at different points of the earth tidal strain cycle (pump). The approach is validated using a larger data set in the Northern Alpine Foreland region where the orientation of maximum horizontal compressive stress is known from borehole breakouts and drilling-induced fractures. The technique resolves NNW-SSW to N-S directed $S$ Hmax which is in good agreement with conventional methods and the recent crustal stress model. We confirm that the NPP method can be applied to dense large-scale seismic arrays. The technique is then applied to the Southern Alps to understand the contemporary stress pattern associated with the ongoing deformation due to counterclockwise rotation of the Adriatic plate with respect to the European plate. Our results explain why the two major faults in Northeastern Italy, the Giudicarie Fault and the Periadriatic Line (Pustertal–Gailtal Fault) are currently inactive, while the currently acting stress field allows faults in Slovenia to deform actively. We have demonstrated that the pump-probe method has the potential to fill in the measurement gap left by conventional approaches, both in terms of regional coverage and in depth.

58 GEOSCIENCES↗

A Platform-Independent X-ray Diffraction Diagnostic for Phase Transition Kinetics in Traditional and Synthetic Microstructure Materials (LDRD Project 213088 Final Report)

Pulsed-power generators using the magnetic loading technique are able to produce well-controlled continuous ramp compression of condensed matter for high-pressure equation-of-state studies. X-ray diffraction (XRD) data from dynamically compressed samples provide direct measurements of the elastic compression of the crystal lattice, onset of plastic flow, strength-strain rate dependence, structural phase transitions, and density of crystal defects such as dislocations. Here, we present a cost effective, compact X-ray source for XRD measurements on pulsed-power-driven ramp-loaded samples. This combination of magnetically-driven ramp compression of materials with single, short-pulse XRD diagnostic will be a powerful capability for the dynamic materials community. The success in fielding this new XRD diagnostic dramatically improves our predictive capability and understanding of rate-dependent behavior at or near phase transition. As Sandia plans the next-generation pulse-power driver platform, a key element needed to deliver new state-of-the-art experiments will be having the necessary diagnostic tools to probe new regimes and phenomena. These diagnostics need to be as versatile, compact, and portable as they are powerful. The development of a platform-independent XRD diagnostic gives Sandia researchers a new window to study the microstructure and phase dynamics of materials under load. This project has paved the way for phase transition research in a variety of materials with mission interest.

36 MATERIALS SCIENCE↗

LANL-UW Collaboration on LC-QTOF Datasets (Annual Report)

Prior to the application of non-targeted chemometric techniques (i.e., Fisher ratio analysis), pre-processing steps must be carried out on the data collected using liquid chromatography-quadrupole time of flight (LC-QTOF) mass spectrometry. Data compression is the most important pre-processing step due to the vast number of high-resolution mass channels (m/z; 0.0001 Da) collected. Our first approach was to bin the mass spectral dimension to 0.01 Da; however, this approach was computationally expensive and did not preserve the high-resolution data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Weak-Form Latent Space Dynamics Identification

This software showcases the enhanced capabilities of the Latent Space Dynamics Identification (LaSDI) algorithm through the application of the weak form, resulting in WLaSDI. WLaSDI first compresses the data, then projects it onto test functions, and subsequently learns the local latent space models. Notably, WLaSDI demonstrates significantly improved robustness to noise. Using weak-form equation learning techniques, WLaSDI achieves local latent space modeling. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form ensures robust and precise latent space recovery, enabling fast, robust, and accurate simulations. We demonstrate the efficacy of WLaSDI against LaSDI using several common benchmark examples, including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in 1D inviscid Burgers' simulations with up to 100% Gaussian white noise, WLaSDI maintains relative errors consistently below 6%, whereas LaSDI errors can exceed 10,000%. Similarly, in radial advection simulations, WLaSDI keeps relative errors below 16%, compared to potential errors of up to 10,000% with LaSDI. Additionally, WLaSDI achieves significant speedups, such as a 140X speedup in 1D Burgers' simulations compared to the corresponding full order model.

Choi, Youngsoo↗

Three-dimensional full-field velocity measurements in shock compression experiments using stereo digital image correlation

Shock compression plate impact experiments conventionally rely on point-wise velocimetry measurements based on laser-based interferometric techniques. This study presents an experimental methodology to measure the free surface full-field particle velocity in shock compression experiments using high-speed imaging and three-dimensional (3D) digital image correlation (DIC). The experimental setup has a temporal resolution of 100 ns with a spatial resolution varying from 90 to 200 μm/pixel. Experiments were conducted under three different plate impact configurations to measure spatially resolved free surface velocity and validate the experimental technique. First, a normal impact experiment was conducted on polycarbonate to measure the macroscopic full-field normal free surface velocity. Second, an isentropic compression experiment on Y-cut quartz–tungsten carbide assembly is performed to measure the particle velocity for experiments involving ramp compression waves. To explore the capability of the technique in multiaxial loading conditions, a pressure shear plate impact experiment was conducted to measure both the normal and transverse free surface velocities under combined normal and shear loading. The velocities measured in the experiments using digital image correlation are validated against previous data obtained from laser interferometry. Numerical simulations were also performed using established material models to compare and validate the experimental velocity profiles for these different impact configurations. The novel ability of the employed experimental setup to measure full-field free surface velocities with high spatial resolutions in shock compression experiments is demonstrated for the first time in this work.

47 OTHER INSTRUMENTATION↗

LA-R43S6-L1 Postshot Report [Slides]

The Ranchero LA-R43S6-L1 test (formerly referred to as LA-43S-L1. The R specifically designates it is a Ranchero device and the 6 indicates a 6” high explosive charge diameter in anticipation of using larger diameters in the future.) was conducted on 3/8/17 with good success. The experiment was the first test of a “Swooped” Ranchero flux compression generator (FCG), and the load for the test was an aluminum imploding liner. In addition to the swoop, the stator was anodized to provide an insulating layer instead of one or more layers of polyethylene as had been the case for all earlier Ranchero tests. Using the Firing point TA-39-88 capacitor bank, 3.5 MA was delivered to the FCG for the initial magnetic field, and 36.4 MA were delivered to the load having an initial inductance of 2.5 nH. Implosion speeds over 1.1 cm/us were recorded, which exceeds previous LANL solid liner experimental results. The test was diagnosed with 18 PDV channels, 12 of which recorded liner implosion data, and the other 6 of which tracked the FCG armature during flux compression. These armature expansion data recorded during flux compression are the first of their kind, and it was previously unknown, due to unknown effects of the SF 6 in the flux compression volume, whether or not the expansion could be recorded using the PDV technique. Post shot 2D MHD calculations employed a complete external circuit model, and an improved flux diffusion model not available prior to the test. Results from these simulations show very good agreement with the experimental result. Four PDV channels recorded the liner implosion viewed radially outward from the center of the liner. All four of these probes recorded implosion velocities greater that 1 cm/µs, with the cylindrical center displaced by ~2 mm from actual center. Four PDV channels looked at +10° angles from the CMU wall, and four looked at -10° angles. A glide plane interaction is shown moving toward the center of the liner in MHD calculations, and PDV probes provide confirmation. The high explosive (HE) in the LA-R43S6-L1 test was PBX 9501 which had to be glued together in many pieces, and the test was preceded by a camera test to verify that the PBX 9501 could be assembled with acceptable tolerance in glue joints to prevent severing the armature during expansion. The camera test verified an acceptable armature performance, and results are given in complete detail in a post shot report LA-UR-19-20124, and summarized here. This report provides complete detail of the considerable body of data obtained on the test and in the post shot calculations. It is prepared in Power Point for ease of preparation and future review. Shot documentation available in the LANL on-line library are included as references, and non-referenceable documents will be cited and stored in an LA- R43S6-L1 post shot folder stored on an M-6 shared drive. Fabrication drawings are also maintained in an M-6 shared drive and paper files are available from M-6 personnel. This report will be maintained as a PowerPoint document on the shared drive, as well, since included movies will play and graphs from Excel files retain information in the PowerPoint versions. PDF versions are required for clearance and are not to large to send by e-mail.

42 ENGINEERING↗