Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Cosmological neutrino simulations at extreme scale

Constraining neutrino mass remains an elusive challenge in modern physics. Precision measurements are expected from several upcoming cosmological probes of large-scale structure. Achieving this goal relies on an equal level of precision from theoretical predictions of neutrino clustering. Numerical simulations of the non-linear evolution of cold dark matter and neutrinos play a pivotal role in this process. We incorporate neutrinos into the cosmological N-body code CUBEP3M and discuss the challenges associated with pushing to the extreme scales demanded by the neutrino problem. We highlight code optimizations made to exploit modern high performance computing architectures and present a novel method of data compression that reduces the phase-space particle footprint from 24 bytes in single precision to roughly 9 bytes. We scale the neutrino problem to the Tianhe-2 supercomputer and provide details of our production run, named TianNu, which uses 86% of the machine (13,824 compute nodes). With a total of 2.97 trillion particles, TianNu is currently the world’s largest cosmological N-body simulation and improves upon previous neutrino simulations by two orders of magnitude in scale. We finish with a discussion of the unanticipated computational challenges that were encountered during the TianNu runtime.

79 ASTRONOMY AND ASTROPHYSICS↗

Correction of the baseline fluctuations in the GEM-based ALICE TPC

To operate the ALICE Time Projection Chamber in continuous mode during the Run 3 and Run 4 data-taking periods of the Large Hadron Collider, the multi-wire proportional chamber-based readout was replaced with gas-electron multipliers. As expected, the detector performance is affected by the so-called common-mode effect, which leads to significant baseline fluctuations. A detailed study of the pulse shape with the new readout has revealed that it is also affected by ion tails. Since reconstruction and data compression are performed fully online, these effects must be corrected at the hardware level in the FPGA-based common readout units. The characteristics of the common-mode effect and of the ion tail, as well as the algorithms developed for their online correction, are described in this paper. The common-mode dependencies are studied using machine-learning techniques. Toy Monte Carlo simulations are performed to illustrate the importance of online corrections and to investigate the performance of the developed algorithms.

47 OTHER INSTRUMENTATION↗

Unsupervised Segmentation and Clustering Workflow for Efficient Processing of 4D-STEM and 5D-STEM Data

Four-dimensional scanning transmission electron microscopy (4D-STEM) enables mapping of diffraction information with nanometer-scale spatial resolution, offering detailed insight into local structure, orientation, and strain. However, as data dimensionality and sampling density increase, particularly for in situ scanning diffraction experiments (5D-STEM), robust segmentation of structurally consistent behavior across sequential measurements becomes essential for efficient and physically meaningful analysis. Here, we introduce a clustering framework that identifies crystallographically distinct domains from 4D-STEM datasets. By using local diffraction-pattern similarity as a metric, the method extracts closed contours delineating spatially contiguous regions. This approach produces cluster-averaged diffraction patterns that improve signal quality while reducing data volume by orders of magnitude, enabling rapid and accurate orientation, phase, and strain mapping. We demonstrate the applicability of this approach to in situ liquid-cell 4D-STEM data of gold nanoparticle growth. Our method provides a scalable and generalizable route for spatially coherent segmentation, data compression, and quantitative structure–strain mapping across diverse 4D-STEM modalities. The full analysis code and example workflows are publicly available to support reproducibility and reuse.

4D-STEM↗

Equation of state of a high-pressure phase of Gd 3 Ga 5 O 12

Gd 3 Ga 5 O 12 (GGG), which crystallizes in the garnet structure at ambient conditions, was observed to transform to a high-pressure phase at 88 GPa after laser heating at 1500 K. This new phase is stable at least up to 180 GPa, and can be preserved on decompression to 50 GPa. This phase is cubic and consistent with a perovskite structure of stoichiometry (Gd 0.75 Ga 0.25 )GaO 3 . The zero-pressure bulk modulus, K 0 , obtained from fitting to a Birch-Murnaghan equation of state is 373(5) GPa with a fixed pressure derivative K' 0 =4. At 170 GPa, the bulk modulus of perovskite-type GGG is 979(15) GPa, which is comparable to that of diamond at the same pressure [956(21) GPa] and consistent with recently reported shock-compression data for Gd 3 Ga 5 O 12 . The new high-pressure phase of Gd 3 Ga 5 O 12 is thus highly incompressible.

36 MATERIALS SCIENCE↗

I n s i t u observation of a phase transition in silicon carbide under shock compression using pulsed x-ray diffraction

The behavior of silicon carbide (SiC) under shock compression is of interest due to its applications as a high-strength ceramic and for general understanding of shock-induced polymorphism. Here we use the Matter in Extreme Conditions beamline of the Linac Coherent Light Source to carry out a series of time-resolved pump-probe x-ray diffraction measurements on SiC laser-shocked to as high as 206 GPa. Experiments on single crystals and polycrystals of different polytypes show a transformation from a low-pressure tetrahedral phase to the high-pressure rocksalt-type (B1) structure. We directly observe coexistence of the low- and high-pressure phases in a mixed-phase region and complete transformation to the B1 phase above 200 GPa. The densities measured by x-ray diffraction are in agreement with both continuum gas-gun studies and a theoretical B1 Hugoniot derived from static-compression data. Time-resolved measurements during shock loading and release reveal a large hysteresis upon unloading, with the B1 phase retained to as low as 5 GPa. The sample eventually reverts to a mixture of polytypes of the low-pressure phase at late times. Our study demonstrates that x-ray diffraction is an effective means to characterize the time-dependent structural response of materials undergoing shock-induced phase transformations at megabar pressures.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Large Deviations of the Maximum Eigenvalue for Wishart and Gaussian Random Matrices

We present a Coulomb gas method to calculate analytically the probability of rare events where the maximum eigenvalue of a random matrix is much larger than its typical value. The large deviation function that characterizes this probability is computed explicitly for Wishart and Gaussian ensembles. The method is general and applies to other related problems, e.g., the joint large deviation function for large fluctuations of top eigenvalues. Our results are relevant to widely employed data compression techniques, namely, the principal components analysis. Analytical predictions are verified by extensive numerical simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Hybrid Approaches for Data Reduction of Spatiotemporal Scientific Applications

Scientists conduct large-scale simulations to compute derived quantities from primary data. Thus, it is crucial that data compression techniques maintain bounded errors on these derived quantities or quantities of interest (QOI). For many spatiotemporal applications, these QOIs are binary in nature and represent presence or absence of a physical phenomenon. In this work, we propose to use a hybrid approah for differential compression for such applications. We use a neural network (NN) approach to determine regions-of-interest (ROIs) where the binary QOIs are going to be prevalent. This is then used with traditional approaches that compress at a lower level (and higher accuracy) for these ROIs as compared to other regions.

Li, Xiao↗

SNS: A Solution-Based Nonlinear Subspace Method for Time-Dependent Model Order Reduction

Several reduced order models have been successfully developed for nonlinear dynamical systems. To achieve a considerable speed-up, a hyper-reduction step is needed to reduce the computational complexity due to nonlinear terms. Many hyper-reduction techniques require the construction of nonlinear term basis, which introduces a computationally expensive offline phase. A novel way of constructing nonlinear term basis within the hyper-reduction process is introduced. In contrast to the traditional hyper-reduction techniques where the collection of nonlinear term snapshots is required, the SNS method avoids collecting the nonlinear term snapshots. Instead, it uses the solution snapshots that are used for building a solution basis, which enables avoiding an extra data compression of nonlinear term snapshots. As a result, the SNS method provides a more efficient offline strategy than the traditional model order reduction techniques, such as the DEIM, GNAT, and ST-GNAT methods. The SNS method is theoretically justified by the conforming subspace condition and the subspace inclusion relation. It is useful for model order reduction of large-scale nonlinear dynamical problems to reduce the offline cost. It is especially useful for ST-GNAT that has shown promising results, such as a good accuracy with a considerable online speed-up for hyperbolic problems in a recent paper by Choi and Carlberg [SIAM J. Sci. Comput., 41 (2019), pp. A26--A58], because ST-GNAT involves an expensive offline cost related to collecting nonlinear term snapshots. Error analysis for the SNS method is presented. Numerical results support that the accuracy of the solution from the SNS method is comparable to the traditional methods and a considerable speed-up (i.e., a factor of two to a hundred) is achieved in the offline phase.

97 MATHEMATICS AND COMPUTING↗

Morpho-Hawk

Morpho-Hawk applies projectional mathematical morphology in a fundamentally new way. Morpho-Hawk extracts object information from digital images by filtering with simple geometrical figures such as rectangles or simple curves. Two core algorithms are used to accomplish this: 1) Object Detection and Feature Extraction from Images: Using projectional morphology, Morpho-Hawk finds features of interest within an image, such as contours, shapes, colors, infrared spectra, and more. Because Morpho-Hawk identifies features based on shape or form, the method can uniquely handle different image or object conditions and directions. MorphoHawk can evaluate all possible images of the analyzed scene using the same transformations that are applied just to one image of that scene. Hence, recognizing a defect within an image or part of an image provides information to assist in recognizing other objects in the image. In addition, known background image information can be morphologically subtracted out in order to focus on the appearance or disappearance of the features of interest. 2) Object Analysis: Upon detection of an object of interest, Morpho-Hawk can analyze the object based learned information from prior images or end-user defined criteria for certain object of special interest by selecting feature (e.g., color, size, shape, apparent volume) and/or symbol (e.g., letter, number). The novel algorithm can analyze targeted objects, even as conditions of such as illumination, shadows, and spectral regions change strongly in following images as compared to the original image. This enables robust recognition, interpolation and prediction. As the analysis shows the presence of these features in the optical signal, the algorithm can make a determination based on user defined probability. The object information can be stored for later analysis using simple morphological data compression methods and/or retention of the original optical images.

Glazoff, MichaelV.↗

MrHyDE v.1.0

SAND2024-01324O MrHyDE, which stands for Multi-resolution Hybridized Differential Equations, is a general-purpose C++ package for the solution of coupled multiphysics and multiscale systems on massively parallel computing systems. MrHyDE is designed to enable moving beyond forward simulation for multiscale applications which includes optimization, control, uncertainty quantification, and stochastic inversion. The framework provides interfaces to several packages within the Trilinos framework and leverages automatic differentiation to enable adjoint capabilities for large-scale, gradient-based optimization. MrHyDE provides automated multiscale capabilities through a subgrid model interface and multiscale Dirichlet-to-Neumann maps. For extreme-scale applications, MrHyDE provides in situ data-compression algorithms to reduce memory requirements while maintaining performance. MrHyDE is a general-purpose, computational framework for the solution of multiscale and multiphysics applications. It uses a combination of structure-preserving, physics-compatible discretizations, fully implicit methods, multi-resolution schemes, or fully explicit methods. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

SciDAC↗

BoBa

BoBa is a C++ software library for working with large matrices, tensors, and tensor decompositions. The library provides tools for dense matrix and tensor operations, tensor decompositions, and tensor decomposition methods that support modern CPU and GPU architectures. It includes portable abstractions for linear algebra, tensor algebra, and multidimensional computation. BoBa is intended for scientific computing applications that involve large multidimensional data sets or high dimensional mathematical models. Its capabilities support tasks such as data compression, linear algebra, efficient numerical computation, and the development of scalable algorithms for heterogeneous hardware. Tutorials, tests, and example applications are included to help users learn and apply the library.

Yao, Jin [Lawrence Livermore National Laboratory (↗

An optimized FM-index library for nucleotide and amino acid search

Abstract Background Pattern matching is a key step in a variety of biological sequence analysis pipelines. The FM-index is a compressed data structure for pattern matching, with search run time that is independent of the length of the database text. Implementation of the FM-index is reasonably complicated, so that increased adoption will be aided by the availability of a fast and flexible FM-index library. Results We present AvxWindowedFMindex (AWFM-index), a lightweight, open-source, thread-parallel FM-index library written in C that is optimized for indexing nucleotide and amino acid sequences. AWFM-index introduces a new approach to storing FM-index data in a strided bit-vector format that enables extremely efficient computation of the FM-index occurrence function via AVX2 bitwise instructions, and combines this with optional on-disk storage of the index’s suffix array and a cache-efficient lookup table for partial k-mer searches. The AWFM-index performs exact match count and locate queries faster than SeqAn3’s FM-index implementation across a range of comparable memory footprints. When optimized for speed, AWFM-index is $$\sim $$ ∼ 2–4x faster than SeqAn3 for nucleotide search, and $$\sim $$ ∼ 2–6x faster for amino acid search; it is also $$\sim $$ ∼ 4x faster with similar memory footprint when storing the suffix array in on-disk SSD storage. Conclusions AWFM-index is easy to incorporate into bioinformatics software, offers run-time performance parameterization, and provides clients with FM-index functionality at both a high-level (count or locate all instances of a query string) and low-level (step-wise control of the FM-index backward-search process). The open-source library is available for download at https://github.com/TravisWheelerLab/AvxWindowFmIndex.

59 BASIC BIOLOGICAL SCIENCES↗

Molecular Solid EOS based on Quasi-Harmonic Oscillator approximation for phonons

A complete equation of state (EOS) for a molecular solid is derived utilizing a Helmholtz free energy. Assuming that the solid is nonconducting, phonon excitations dominate the specific heat. Phonons are approximated as independent quasi-harmonic oscillators with vibrational frequencies depending on the specific volume. The model is suitable for calibrating an EOS based on isothermal compression data and infrared/Raman spectroscopy data from high pressure measurements utilizing a diamond anvil cell. In contrast to a Mie-Gruneisen EOS developed for an atomic solid, the specific heat and Gruneisen coefficient depend on both density and temperature.

97 MATHEMATICS AND COMPUTING↗

Electronics for a Picosecond Time-of-flight Measurement

TITLE: Electronics for a Picosecond Time-of-flight Measurement ABSTRACT: Time-of-flight (TOF) detectors have historically been used as part of the particle identification capability of multi-purpose particle physics detectors. An accurate time measurement, combined with a momentum measurement based on the curvature of the track in a magnetic field, is often sufficient to determine the particle's mass, and thus its identity. Such detectors typically have measured the particle flight time extremely precisely, with an uncertainty of one hundred trillionths of a second (also referred to as 100 picoseconds). To put this in perspective it would be like counting all the people on the Earth and getting it right within 1 person! Another use of TOFs is to measure the vertex of the event, which is the location along the beam line where the incoming particles (typically protons) collide. This vertex positon is a well measured quantity for events where the protons collide “head on” as the outgoing particles produced when you blast the proton apart can be used to trace back to a vertex point from which they originated. More frequently the protons just strike a glancing blow and remain intact—in this case they are nearly parallel to the beam and you cannot tell their vertex without this ability to precisely measure the time of flight of the protons. Occasionally both happen in the same event, that is, a central system and two protons are produced. But are they from the same collision, or just a boring background where more than one collision in the same bunch crossing conspire to fake the signal of interest? That’s where the timing of the protons comes into play. The main idea is to measure the time it takes for the two protons to reach TOF detectors positioned equidistant from the center of the main detector. If the vertex is displaced to one side than that detector will measure a shorter time while the other side detector will measure a correspondingly longer time. Taking into account the speed of the particles, which is very close to the speed of light, an accuracy of 100 ps gives a vertex measurement of a few cm or a little more than an inch. At the Large Hadron Collider, where there are up to a hundred billion protons per bunch, and the collision region is compressed to a few inches, that is just not good enough. A higher level of precision is needed to determine whether the vertex of the protons and that of the central system are the same. A factor 10 improvement in the timing measurement to the 10 trillionths of a second level, for example would give the requisite 10 times improvement in the vertex measurement. An accurate measurement of the flight time depends on three key elements: the radiator that produces light when the proton passes through it, the photo-sensor that converts the light to an electrical signal, and the electronics that convert this electrical signal into a time measurement with a compact recordable format. With recent improvements in detector design featuring a series of quartz radiators connected to a micro-channel plate photomultiplier tube, this superior measurement capability is within reach if the readout electronics are sufficiently performant. As a result of the funding of this proposal, we have achieved our primary goals. 1) We have developed from scratch or improved upon existing designs of the full chain of electronics that can maintain the performance of a TOF detector from the output of the photo-sensor to the recording of a compressed data packet containing the timing information. We have accomplished this with a cost effective modular approach such that some or all of the components in the chain could easily be adapted for use in diverse particle physics experiments or in other areas where precise timing is required, such as medical and homeland security devices.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Final Report for Grant DOE DE-FG02-08ER64573 (Relating to Turbulence Modeling)

Turbulence enhances transport and mixing. Turbulent ocean currents can increase the encounter rate between fish larvae and their prey. Without turbulence, the fuel and air injected into the cylinder of an internal combustion engine would mix too slowly to be effective. Birds extract energy from turbulent winds to soar for great distances without flapping their wings. Turbulence can be detrimental as well. The efficiencies of vehicles, pipelines, and industrial equipment are all hindered by turbulence. Turbulence can also cause structural fatigue, generate unwanted noise, and distort the propagation of electromagnetic signals. These observations highlight the importance of turbulence research. Our ability to predict and control turbulence and, thus, to intensify or suppress its effects as circumstances warrant is contingent on our understanding of the underlying mechanisms. Turbulence is also immensely interesting from a purely scientific perspective and is a great source of fundamentally important, challenging problems for physicists, engineers, and mathematicians. Moreover, various methods and tools developed in the field have found applications in other fields, including nonlinear optics, nonlinear acoustics, pattern formation, image processing, data compression, and econophysics. It is possible, at least away from walls, to derive LES models of very high-order accuracy. However, these models also lead to correspondingly intense computational complexity for their numerical solution. Some also introduce yet more questions on the already difficult problem of specifying needed and sometimes artificial local boundary conditions for the inherently nonlocal flow averages. For these two (and other) reasons, there has been a resurgence of interest in basing simulations of turbulent flows on much simpler regularizations of the Navier–Stokes equations rather than on full models of local averages--i.e., LES models. Initially these were developed as pure theoretical tools. The influx of ideas from LES and the added constraint that the regularization be amenable to numerical simulation have breathed new perspective and thus new life into this thread of ideas.Over the past year, a significant portion of our research activity has focused on numerical studies of the Navier–Stokes-$αβ$ model and extensions thereof. Our results regarding these and other approaches to turbulence modeling are described below.

97 MATHEMATICS AND COMPUTING↗

Plate impact experiments on DC745U cooled to ~ -60 °C

Using gas-gun driven plate impact experiments, we have measured the U S - u p Hugoniot of the silicone elastomer DC745U cooled to -60 °C. In summary, the initial density changes from p 0 (23°C) = 1.312 ± 0.010 g/cm 3 to p 0 (-60°C) = 1.447 ± 0.011 g/cm 3 . The linear U S - u p Hugoniot changes from U S = 1.62 + 1.74u p km/s at +23°C, to U S = 2.03 ± 0.06 + (2.03 ± 0.06) u p km/s at -60°C. DC745U, therefore is much stiffer at -60°C than at +23°C, probably due to the crystallization that occurs at ~ -50°C. Caveats/deficiencies: 1) This report does not provide an adequate pedigree of the DC745U used. 2) References to unpublished room temperature shock compression data on the elastomer are inadequate. 3) The report has not been fact checked by a DC745 subject matter expert.

36 MATERIALS SCIENCE↗

Wave transmission through silicone foam pads in a compression Kolsky bar apparatus. Comparisons between simulations and measurements.

This memo concerns the transmission of mechanical signals through silicone foam pads in a compression Kolsky bar set-up. The results of numerical simulations for four levels of pad pre-compression and two striker velocities were compared directly to test measurements to assess the delity of the simulations. The nite element model simulated the Kolsky tests in their entirety and used the hyperelastic `hyperfoam' model for the silicone foam pads. Calibration of the hyperfoam model was deduced from quasi-static compression data. It was necessary, however, to augment the material model by adding sti ness proportional damping in order to generate results that resembled the experimental measurements. Based on the results presented here, it is important to account for the dynamic behavior of polymeric foams in numerical simulations that involve high loading rates.

47 OTHER INSTRUMENTATION↗

Reducing Computation and Communication in Scientific Computing: Connecting Theory to Practice.

This report summarizes the work produced as part of a Truman Fellowship appointment and its associated LDRD project. The overall goal of the project was to develop better algorithms and implementations for key computational kernels within the field of scientific computing by designing them to be communication efficient, moving as little data as possible. The primary problem of interest was dense matrix multiplication; other computations that were addressed include sparse matrix-matrix multiplication, QR factorization, solving symmetric linear systems, and the symmetric eigendecomposition. The project also involved the study of computations at the intersection of scientific computing and data analysis, including nonnegative matrix factorization for discovering latent factors, Tucker tensor decomposition for data compression, and sampling methods for similarity search.

97 MATHEMATICS AND COMPUTING↗