SEARCH · Engineering Papers

Results for “data compression techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Uncertainty Visualization of Critical Points of 2D Scalar Fields for Parametric and Nonparametric Probabilistic Models

This paper presents a novel end-to-end framework for closed-form computation and visualization of critical point uncertainty in 2D uncertain scalar fields. Critical points are fundamental topological descriptors used in the visualization and analysis of scalar fields. The uncertainty inherent in data (e.g., observational and experimental data, approximations in simulations, and compression), however, creates uncertainty regarding critical point positions. Uncertainty in critical point positions, therefore, cannot be ignored, given their impact on downstream data analysis tasks. Here, in this work, we study uncertainty in critical points as a function of uncertainty in data modeled with probability distributions. Although Monte Carlo (MC) sampling techniques have been used in prior studies to quantify critical point uncertainty, they are often expensive and are infrequently used in production-quality visualization software. We, therefore, propose a new end-to-end framework to address these challenges that comprises a threefold contribution. First, we derive the critical point uncertainty in closed form, which is more accurate and efficient than the conventional MC sampling methods. Specifically, we provide the closed-form and semianalytical (a mix of closed-form and MC methods) solutions for parametric (e.g., uniform, Epanechnikov) and nonparametric models (e.g., histograms) with finite support. Second, we accelerate critical point probability computations using a parallel implementation with the VTK-m library, which is platform portable. Finally, we demonstrate the integration of our implementation with the ParaView software system to demonstrate near-real-time results for real datasets.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Machine learning for domain transfer between simulated and experimental 2D X-ray diffraction patterns using generative adversarial networks

X-ray diffraction (XRD) is a well-established technique for analyzing materials at an atomic level. Dynamic compression experiments (DCE), in which materials are subject to extreme pressures, can provide fundamental understanding to pressure-induced phase transitions and compression of the crystal lattice. The analysis of XRD patterns from highly compressed samples is non-trivial given the sparsity of data, high experimental costs, and the fact that the data is often marred with X-ray background and other artifacts. While accurate computational frameworks exist, they solve the forward problem—from structures and orientations to XRD patterns. Solving the inverse problem for 2D experimental diffraction patterns is currently a complex manual process of matching and comparing experimentally observed patterns to computationally generated ones. Machine learning is a promising tool for automating the matching process but often requires data-intensive architectures. Here, in this study, we use a CycleGAN to translate the domain of limited experimental data to a domain in which there is readily available simulated data. This domain shift allows data-intensive machine learning models that have only been trained on simulated XRD patterns to be used in the analysis of experiments.

Brozak, Samantha Jean [Sandia National Laboratorie↗

DOE OSTI2024

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗

DOE OSTI2022

Image Provenance Analysis

The literature of multimedia forensics is mainly dedicated to the analysis of single assets (such as sole image or video files), aiming at individually assessing their authenticity. Different from this, image provenance analysis is devoted to the joint examination of multiple assets, intending to ascertain their history of edits, by evaluating pairwise relationships. Each relationship, thus, expresses the probability of one asset giving rise to the other, through either global or local operations, such as data compression, resizing, color-space modifications, content blurring, and content splicing. The principled combination of these relationships unveils the provenance of the assets, also constituting an important forensic tool for authenticity verification. This chapter introduces the problem of provenance analysis, discussing its importance and delving into the state-of-the-art techniques to solve it.

Moreira, Daniel↗

DOE OSTI2020

Discrete element modeling of switchgrass particles under compression and rotational shear

Switchgrass is a perennial herbaceous plant regarded as a biomass energy crop in the United States for its highadaptability and yield potential. Processing and handling of switchgrass particles are challenging due to the erratic mechanical and flow behavior originating from their intrinsic particulate properties. Here, we present a bonded-sphere discrete element model designed specifically for switchgrass particles. The model simultaneously captures three key particulate features, i.e., fibrous particle shapes, a wide range of particle sizes, and particle deformability. Realistic yet computationally efficient particle shape templates are created based on the image analysis data of switchgrass specimens. A fitting procedure is proposed to ensure both the particle width and length distributions are captured, a unique requirement for fibrous particles. Two full-scale numerical models, i.e., a uniaxial compression model and a Schulze ring shear model, are developed using information fromphysical experiments. The model is calibrated using experimental data of chopped-small switchgrass specimens, and then, is validated using data of chopped-large specimens in both compression and ring-shear tests. Numerical results show that the numerical models capture bulk densities accurately (with an error of 3%) while slightly underestimate the bulk friction angle. Furthermore, an extensive sensitivity analysis reveals that (1) switchgrass particles with rougher edges (due to different processing techniques) exhibit a higher shear strength and a lower flowability; (2) stiffer particles yield a lower bulk density (up to 21% lower) compared to more deformable particles, indicating particle deformability should be incorporated when modeling biomass flow in a preprocessing system.

09 BIOMASS FUELS↗

DOE OSTI2021

Acoustic velocities, elasticity, and pressure-induced elastic softening in compressed neodymium

For the first time, the acoustic velocities and elasticity of double hexagonal close-packed neodymium (Nd) were measured at high pressure using ultrasonic interferometry in conjunction with synchrotron X-ray techniques. Here, both the compressional and shear wave velocities increased with an increase in pressure of up to ~5.4 GPa before they exhibited almost constant values upon further compression. This pressure-induced elastic wave velocity softening can be attributed to the structural instability in dhcp-Nd. From the current sound velocities and density data, we obtained new bulk and shear moduli as well as their pressure dependence for polycrystalline dhcp-Nd, yielding $B_0$=33.2(9) GPa, $G_0$=14.1(5) GPa, $\partial$$B/$$\partial$$P$ = 3.6 (4) and $\partial$$=G/$$\partial$$P$ = 1.3 (2) while other elasticity-related/mechanical properties, including Young's modulus, Debye temperature, Poisson's ratio, and Grüneisen parameter, which are important parameters for the application of Nd in extreme environments, were also derived.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Direct numerical simulation of hypersonic turbulent boundary layers: effect of spatial evolution and Reynolds number

Direct numerical simulations (DNS) are performed to investigate the spatial evolution of flat-plate zero-pressure-gradient turbulent boundary layers over long streamwise domains ( >300δ i , with δ i the inflow boundary-layer thickness) at three different Mach numbers, 2.5, 4.9 and 10.9, with the surface temperatures ranging from quasiadiabatic to highly cooled conditions. The settlement of turbulence statistics into a fully developed equilibrium state of the turbulent boundary layer has been carefully monitored, either based on the satisfaction of the von Kármán integral equation or by comparing runs with different inflow turbulence generation techniques. The generated DNS database is used to characterize the streamwise evolution of multiple important variables in the high-Mach-number, cold-wall regime, including the skin friction, the Reynolds analogy factor, the shape factor, the Reynolds stresses, and the fluctuating wall quantities. The data confirm the validity of many classic and newer compressibility transformations at moderately high Reynolds numbers (up to friction Reynolds number Re τ ≈1200 ) and show that, with proper scaling, the sizes of the near-wall streaks and superstructures are insensitive to the Mach number and wall cooling conditions. The strong wall cooling in the hypersonic cold-wall case is found to cause a significant increase in the size of the near-wall turbulence eddies (relative to the boundary-layer thickness), which leads to a reduced-scale separation between the large and small turbulence scales, and in turn to a lack of an outer peak in the spanwise spectra of the streamwise velocity in the logarithmic region.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Femtosecond diffraction and dynamic high pressure science

Solid-state material at high pressure is prevalent throughout the Universe, and an understanding of the structure of matter under such extreme conditions, gleaned from x-ray diffraction, has been pursued for the best part of a century. The highest pressures that can be reached to date (2 TPa) in combination with x-ray diffraction diagnosis have been achieved by dynamic compression via laser ablation. The past decade has witnessed remarkable advances in x-ray technologies, with novel x-ray Free-Electron-Lasers (FELs) affording the capacity to produce high quality single-shot diffraction data on timescales below 100 fs. We provide a brief history of the field of dynamic compression, spanning from when the x-ray sources were almost always laser-plasma based, to the current state-of-the art diffraction capabilities provided by FELs. We give an overview of the physics of dynamic compression, diagnostic techniques, and the importance of understanding how the rate of compression influences the final temperatures reached. We provide illustrative examples of experiments performed on FEL facilities that are starting to give insight into how materials deform at ultrahigh strain rates, their phase diagrams, and the types of states that can be reached. We emphasize that there often appear to be differences in the crystalline phases observed between the use of static and dynamic compression techniques. We give our perspective on both the current state of this rapidly evolving field and some glimpses of how we see it developing in the near-to-medium term.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2020

The Complicated Link Between Material Properties and Microfracture Density for an Underground Explosion in Granite

Geophysical techniques are often implemented as quick and inexpensive ways to locate and characterize fractures in the subsurface, which is important for a number of geoscience fields. Seismic velocities are the most widely used proxies for identification of fractures, but the correlation is not always well-defined. In this study we present material property data: unconfined compressive strength (UCS), bulk density (ρ), Young's modulus (E), Poisson's ratio (ν), P wave velocity (V p ), and S wave velocity (V s ), in conjunction with microfracture densities measured on samples of granite collected before and after underground chemical explosions. Results indicate the relationship between fractures and material properties is complex, even in this single-lithology environment. We interpret that this complexity arises from varying fracture mechanisms (e.g. dilation-inducing fractures vs compression-inducing fractures) in different parts of the core, due to differences in stress conditions. Additional complexity may result from chemical interactions between the fresh fractures and the fluids in the area. Water content appears to have a significant, if not dominant, role in the unconfined compressive strength (UCS) of the samples. We suggest caution when using elastic property measurements as a proxy for fracturing in areas of explosion-induced damage, or in other areas where a variety of mechanisms induce fracturing.

58 GEOSCIENCES↗

DOE OSTI2020

Isotope effects on the high pressure viscosity of liquid water measured by differential dynamic microscopy

In this paper, differential dynamic microscopy is performed in diamond anvil cells to measure the viscosity of water along the 24 °C isotherm to high-pressure by determination of the tracer diffusion coefficient of monodisperse silica spheres of known diameter and application of the Stokes-Einstein-Sutherland equation. This technique allows liquid samples to be compressed to greater pressure prior to freezing than with other viscometry methods. The highest-pressure measurement was made at 1.67 GPa, considerably deeper into the supercompressed regime than previously reported. The effect of isotopic composition is investigated with samples of normal water, heavy water, and partially deuterated water. When data below 0.25 GPa are excluded a free volume model fits the observed viscosities well yielding a theoretical glass transition density close to that observed in very-high-density amorphous ice. The improved fit above 0.25 GPa coincides with the loss of other anomalous behaviors in liquid water caused by hydrogen bonding and represents a transition to properties closer to those of a simple liquid.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2022

A lightweight, user-configurable detector ASIC digital architecture with on-chip data compression for MHz X-ray coherent diffraction imaging

Today, most X-ray pixel detectors used at light sources transmit raw pixel data off the detector ASIC. With the availability of more advanced ASIC technology nodes for scientific application, more digital functionalities from the computing domains (e.g., compression) can be integrated directly into a detector ASIC to increase data velocity. In this paper, we describe a lightweight, user-configurable detector ASIC digital architecture with on-chip compression which can be implemented in 130 nm technologies in a reasonable area on the ASIC periphery. In addition, we present a design to efficiently handle the variable data from the stream of parallel compressors. The architecture includes user-selectable lossy and lossless compression blocks. The impact of lossy compression algorithms is evaluated on simulated and experimental X-ray ptychography datasets. This architecture is a practical approach to increase pixel detector frame rates towards the continuous 1 MHz regime for not only coherent imaging techniques such as ptychography, but also for other diffraction techniques at X-ray light sources.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Predicting industrial building energy consumption with statistical and machine-learning models informed by physical system parameters

The industrial sector consumes about one-third of global energy, making them a frequent target for energy use reduction. Variation in energy usage is observed with weather conditions, as space conditioning needs to change seasonally, and with production, energy-using equipment is directly tied to production rate. Previous models were based on engineering analyses of equipment and relied on site-specific details. Others consisted of single-variable regressors that did not capture all contributions to energy consumption. Further, new modeling techniques could be applied to rectify these weaknesses. Applying data from 45 different manufacturing plants obtained from industrial energy audits, a supervised machine-learning model is developed to create a general predictor for industrial building energy consumption. The model uses features of air enthalpy, solar radiation, and wind speed to predict weather-dependency; motor, steam, and compressed air system parameters to capture support equipment contributions; and operating schedule, production rate, number of employees, and floor area to determine production-dependency. Results showed that a model that used a linear regressor over a transformed feature space could outperform a support vector machine and utilize features more representative of physical systems. Using informed parameters to build a reliable predictor will more accurately characterize a manufacturing facility's energy savings opportunities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Compressed basis GMRES on high-performance graphics processing units

Krylov methods provide a fast and highly parallel numerical tool for the iterative solution of many large-scale sparse linear systems. To a large extent, the performance of practical realizations of these methods is constrained by the communication bandwidth in current computer architectures, motivating the investigation of sophisticated techniques to avoid, reduce, and/or hide the message-passing costs (in distributed platforms) and the memory accesses (in all architectures). This article leverages Ginkgo’s memory accessor in order to integrate a communication-reduction strategy into the (Krylov) GMRES solver that decouples the storage format (i.e., the data representation in memory) of the orthogonal basis from the arithmetic precision that is employed during the operations with that basis. Given that the execution time of the GMRES solver is largely determined by the memory accesses, the cost of the datatype transforms can be mostly hidden, resulting in the acceleration of the iterative step via a decrease in the volume of bits being retrieved from memory. Together with the special properties of the orthonormal basis (whose elements are all bounded by 1), this paves the road toward the aggressive customization of the storage format, which includes some floating-point as well as fixed-point formats with mild impact on the convergence of the iterative process. We develop a high-performance implementation of the “compressed basis GMRES” solver in the Ginkgo sparse linear algebra library using a large set of test problems from the SuiteSparse Matrix Collection. We demonstrate robustness and performance advantages on a modern NVIDIA V100 graphics processing unit (GPU) of up to 50% over the standard GMRES solver that stores all data in IEEE double-precision.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Electron Tomography and Machine Learning for Understanding the Highly Ordered Structure of Leafhopper Brochosomes

Insects known as leafhoppers (Hemiptera: Cicadellidae) produce hierarchically structured nanoparticles known as brochosomes that are exuded and applied to the insect cuticle, thereby providing camouflage and anti-wetting properties to aid insect survival. Although the physical properties of brochosomes are thought to depend on the leafhopper species, the structure–function relationships governing brochosome behavior are not fully understood. Brochosomes have complex hierarchical structures and morphological heterogeneity across species, due to which a multimodal characterization approach is required to effectively elucidate their nanoscale structure and properties. In this work, we study the structural and mechanical properties of brochosomes using a combination of atomic force microscopy (AFM), electron microscopy (EM), electron tomography, and machine learning (ML)-based quantification of large and complex scanning electron microscopy (SEM) image data sets. This suite of techniques allows for the characterization of internal and external brochosome structures, and ML-based image analysis methods of large data sets reveal correlations in the structure across several leafhopper species. Our results show that brochosomes are relatively rigid hollow spheres with characteristic dimensions and morphologies that depend on leafhopper species. Nanomechanical mapping AFM is used to determine a characteristic compression modulus for brochosomes on the order of 1–3 GPa, which is consistent with crystalline proteins. Altogether, this work provides an improved understanding of the structural and mechanical properties of leafhopper brochosomes using a new set of ML-based image classification tools that can be broadly applied to nanostructured biological materials.

Chemical structure↗

DOE OSTI2022

Processing and Archiving Camera Data Effectively for Operando Neutron Measurement of Metal Additive Manufacturing

As the name suggests, The Operando Neutron Measurement of Metal Additive Manufacturing project conducted by ORNL’s Manufacturing Demonstration Facility (MDF) is experimenting with advanced additive metal manufacturing techniques while analyzing the process using the Spallation Neutron Source’s (SNS) beamline. As part of this experiment, the MDF is seeking to employ 2 XIMEA visible light cameras and a single infrared camera to analyze and correct manufacturing in real-time. The MDF requires a solution for capturing the high-resolution data feed from the cameras with compression while preserving enough detail for their software to detect and correct errors in real time. Our solution was to develop a Robot Operating System (ROS) driver to feed the camera data into ROS. From ROS, the feed is compressed and temporarily stored locally to a stripped 4 NVMe SSD RAID array. Post-experiment, the data is transitioned to long-term storage for archival purposes.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Aero-Optics of Hypersonic Turbulent Boundary Layers

Aero-optics refers to optical distortions due to index-of-refraction gradients that are induced by aerodynamic density gradients. At hypersonic flow conditions, the bulk velocity is many times the speed of sound and density gradients may originate from shock waves, compressible turbulent structures, acoustic waves, thermal variations, etc. Due to the combination of these factors, aero-optic distortions are expected to differ from those common to sub-sonic and lower super-sonic speeds. This report summarizes the results from a 2019-2022 Laboratory Directed Research and Development (LDRD) project led by Sandia National Laboratories in collaboration with the University of Notre Dame, New Mexico State University, and the Georgia Institute of Technology. Efforts extended experimental and simulation methodologies for the study of turbulent hypersonic boundary layers. Notable experimental advancements include development of spectral de-aliasing techniques for highspeed wavefront measurements, a Spatially Selective Wavefront Sensor (SSWFS) technique, new experimental data at Mach 8 and 14, a Quadrature Fringe Imaging Interferometer (QFII) technique for time-resolved index-of-refraction measures, and application of QFII to shock-heated air. At the same time, model advancements include aero-optic analysis of several Direct Numerical Simulation (DNS) datasets from Mach 0.5 to 14 and development of wall-modeled Large Eddy Simulation (LES) techniques for aero-optic predictions. At Mach 8 measured and predicted root mean square Optical Path Differences agree within confidence bounds but are higher than semi-empirical trends extrapolated from lower Mach conditions. Overall, results show that aero-optic effects in the hypersonic flow regime are not simple extensions from prior knowledge at lower speeds and instead reflect the added complexity of compressible hypersonic flow physics.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Correction of the baseline fluctuations in the GEM-based ALICE TPC

To operate the ALICE Time Projection Chamber in continuous mode during the Run 3 and Run 4 data-taking periods of the Large Hadron Collider, the multi-wire proportional chamber-based readout was replaced with gas-electron multipliers. As expected, the detector performance is affected by the so-called common-mode effect, which leads to significant baseline fluctuations. A detailed study of the pulse shape with the new readout has revealed that it is also affected by ion tails. Since reconstruction and data compression are performed fully online, these effects must be corrected at the hardware level in the FPGA-based common readout units. The characteristics of the common-mode effect and of the ion tail, as well as the algorithms developed for their online correction, are described in this paper. The common-mode dependencies are studied using machine-learning techniques. Toy Monte Carlo simulations are performed to illustrate the importance of online corrections and to investigate the performance of the developed algorithms.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

Dynamical Sketching for Enhanced Communication Efficiency in Federated Learning

Federated learning (FL) has revolutionized distributed machine learning by enabling collaborative model training without sharing local data. However, communication efficiency and privacy guarantees remain significant challenges. This paper introduces a dynamic sketching mechanism in FL, optimizing the trade-off between communication efficiency and model accuracy. By dynamically selecting the sketch matrix size, our approach adapts to the evolving characteristics of the data and the model, ensuring optimal performance across diverse scenarios. We leverage Bayesian optimization to systematically tune the sketch parameters, achieving an effective balance between resource efficiency and model performance. Experimental results on the MNIST dataset using a convolutional neural network (CNN) architecture validate the proposed method's efficiency and scalability. Our dynamic sketching approach significantly outperforms fixed-size sketching techniques, achieving higher compression ratios (up to 62x) and providing better privacy guarantees while maintaining high model accuracy. These findings highlight the robustness and versatility of our approach and make it a valuable solution for privacy-preserving, communication-efficient federated learning.

Afrose, Sharmin [ORNL]↗