Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

A Preprocessing Tool for Enhanced Ion Mobility–Mass Spectrometry-Based Omics Workflows

The ability to improve the data quality of ion mobility–mass spectrometry (IM-MS) measurements is of great importance for enabling modular and efficient computational workflows and gaining better qualitative and quantitative insights from complex biological and environmental samples. We developed the PNNL PreProcessor, a standalone and user-friendly software housing various algorithmic implementations to generate new MS-files with enhanced signal quality and in the same instrument format. Different experimental approaches are supported for IM-MS based on Drift-Tube (DT) and Structures for Lossless Ion Manipulations (SLIM), including liquid chromatography (LC) and infusion analyses. The algorithms extend the dynamic range of the detection system, while reducing file sizes for faster and memory-efficient downstream processing. Specifically, multidimensional smoothing improves peak shapes of poorly defined low-abundance signals, and saturation repair reconstructs the intensity profile of high-abundance peaks from various analyte types. Further, other functionalities are data compression and interpolation, IM demultiplexing, noise filtering by low intensity threshold and spike removal, and exporting of acquisition metadata. Several advantages of the tool are illustrated, including an increase of 19.4% in lipid annotations and a two-times faster processing of LC-DT IM-MS data-independent acquisition spectra from a complex lipid extract of a standard human plasma sample. The software is freely available at https://omics.pnl.gov/software/pnnl-preprocessor.

59 BASIC BIOLOGICAL SCIENCES↗

High-pressure single-crystal X-ray diffraction of Tl{sub 2}SeO{sub 4}

The effect of pressure on the crystal structure of thallium selenate (Tl{sub 2}SeO{sub 4}) (Pmcn, Z=4), containing the Tl{sup +} cations with electron lone pairs, has been studied with single-crystal X-ray diffraction in a diamond anvil cell up to 3.64 GPa at room temperature. No phase transition has been observed. The compressibility data are fitted by a Murnaghan equation of state with the zero-pressure bulk modulus B{sub 0}=29(1) GPa and the unit-cell volume at ambient pressure V{sub 0}=529.6(8) A{sup 3} (B'=4.00). Tl{sub 2}SeO{sub 4} is the least compressible in the c direction, while the pressure-induced changes of the a and b lattice parameters are quite similar. These observations can be explained by different pressure effects on the nine- and 11-fold coordination polyhedra around the two non-equivalent Tl atoms. The SeO{sub 4}{sup 2-} tetrahedra are not rigid units and become more distorted. Their contribution to the compressibility is small. The effect of pressure on the isotypical oxide materials A{sub 2}TO{sub 4} with the {beta}-K{sub 2}SO{sub 4} structure is discussed. It appears that the presence of electron lone pairs on the Tl{sup +} cation does not seem to influence the compressibility of Tl{sub 2}SeO{sub 4}. - Graphical abstract: Pressure dependence of normalized lattice parameters and unit-cell volumes in Tl{sub 2}SeO{sub 4} (Pmcn, Z=4). The solid line is the Murnaghan equation of state.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Study of liquid gallium at high pressure using synchrotron x-ray

Liquid gallium has been studied at high pressure up to 2 GPa and ambient temperature in a diamond anvil cell using high energy synchrotron x-ray beam. The total x-ray scattering data of liquid gallium were collected up to Q = 12 A{sup -1} and analyzed using pair distribution functions (PDF). The results indicate that the first nearest neighbor peak and second nearest neighbor (shoulder) peak of PDF in liquid gallium does not change with pressure, whereas the higher order (i.e., third and fourth) nearest neighbor peaks shift towards shorter distance with increasing pressure. Reverse Monte Carlo modeling based on the observed data shows that the coordination number in the liquid gallium increases with pressure from 10.5 at 0.3 GPa to 11.6 at 2 GPa. An atomic arrangement similar to the crystalline phase of Ga(II) with coordination number of 12 is proposed for the locally dense-packed rigid unit in liquid gallium. The volume compression data derived from the structure modeling yield a bulk modulus of 12.1(6) GPa for liquid gallium.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

LANL-UW Collaboration on LC-QTOF Datasets (Annual Report)

Prior to the application of non-targeted chemometric techniques (i.e., Fisher ratio analysis), pre-processing steps must be carried out on the data collected using liquid chromatography-quadrupole time of flight (LC-QTOF) mass spectrometry. Data compression is the most important pre-processing step due to the vast number of high-resolution mass channels (m/z; 0.0001 Da) collected. Our first approach was to bin the mass spectral dimension to 0.01 Da; however, this approach was computationally expensive and did not preserve the high-resolution data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Real-time data reduction at 100 Tbps: Challenge and opportunity for AI-based data reduction for next-generation large-scale nuclear physics collider experiment

The modern large-scale nuclear physics (NP) experiments in high-energy particle colliders utilize streaming-readout electronics to digitize detector response at O(100) Tbps bandwidth. Prominent examples at Brookhaven National Lab (BNL) include the sPHENIX experiment at Relativistic Heavy Ion Collider (RHIC), which is under construction, and the experiments proposed for the Electron-Ion Collider (EIC), planned for the 2030s . One of the main challenges for these streaming readout systems is to manage the data rate with sufficient data reduction in real time so the end-data fit persistent storage for offline analysis, which is typically at O(1000) times smaller and O(100) Gbps. Such data reduction traditionally is achieved via real-time high level triggers, which select and save a small subset of collisions of interest. Although triggering is applicable to high energy collider experiments such as those at the Large Hardron Collider at CERN, it is insufficient for these nuclear physics experiments which study diverse collision topologies. And traditional triggering approach is inefficient to preserve the max information harvested from the operation of colliders that costs O(100)M per year to DOE. Meanwhile, in recent years, ML-based high-throughput data reduction has emerged as a promising approach to efficiently preserve max information for a given space of persistent storage, e.g. via AI data compression, feature extraction, and noise filtering.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Ensemble Kalman filter for data assimilation coupled with low-resolution computations techniques applied in fluid dynamics

This paper presents an innovative Reduced-order model (ROM) for merging experimental and simulation data using data assimilation (DA) to estimate the "True" state of a fluid dynamics system, leading to more accurate predictions. Our methodology introduces a novel approach by implementing the ensemble Kalman filter (EnKF) within a reduced-dimensional framework, grounded in a robust theoretical foundation and applied to fluid dynamics. To address the substantial computational demands of DA, the proposed ROM employs low-resolution (LR) techniques to drastically reduce computational costs. This innovative approach involves downsampling datasets for DA computations, followed by an advanced reconstruction technique based on low-cost singular value decomposition (lcSVD). The lcSVD method, a key innovation in this paper, has never been applied to DA before and offers a highly efficient way to enhance resolution with minimal computational resources. Our results demonstrate significant reductions in both computation time and RAM usage through these LR techniques without compromising the accuracy of the estimations. For instance, in a turbulent test case, for a data compression rate of 15.9, the LR approach can achieve a speed-up of 13.7 and a RAM compression of 90.9% while maintaining a low relative root mean square error (RRMSE) of 2.6%, compared to 0.8% in the high-resolution (HR) reference. Furthermore, we highlight the effectiveness of the EnKF in estimating and predicting the state of fluid flow systems based on limited observations and given low-fidelity numerical data. This paper highlights the potential of the proposed DA method in fluid dynamics applications, particularly for improving computational efficiency in CFD and related fields. Its ability to balance accuracy with low computational and memory costs makes it especially suitable for large-scale and real-time applications, such as environmental monitoring or engineering design. This method will be incorporated into ModelFLOWs-app.

Data Assimilation↗

Learning and diagnosing faults using neural networks

Neural networks have been employed for learning fault behavior from rocket engine simulator parameters and for diagnosing faults on the basis of the learned behavior. Two problems in applying neural networks to learning and diagnosing faults are (1) the complexity of the sensor data to fault mapping to be modeled by the neural network, which implies difficult and lengthy training procedures; and (2) the lack of sufficient training data to adequately represent the very large number of different types of faults which might occur. Methods are derived and tested in an architecture which addresses these two problems. First, the sensor data to fault mapping is decomposed into three simpler mappings which perform sensor data compression, hypothesis generation, and sensor fusion. Efficient training is performed for each mapping separately. Secondly, the neural network which performs sensor fusion is structured to detect new unknown faults for which training examples were not presented during training. These methods were tested on a task of fault diagnosis by employing rocket engine simulator data. Results indicate that the decomposed neural network architecture can be trained efficiently, can identify faults for which it has been trained, and can detect the occurrence of faults for which it has not been trained.

Whitehead, Bruce A.↗

Entropy encoding applied to a video DM bit stream

This paper investigates bandwidth compression of delta modulated video signals using a variety of novel techniques. The video signal is encoded at 16 MHz with an adaptive delta modulator (ADM) using the Song video mode algorithm. One method of achieving bandwidth compression is through the detection and reduction of steady state patterns in the DM bit stream. Further reduction is obtained by deleting the horizontal and vertical drive information. Finally, a modified ADM algorithm is introduced to increase the frequency of steady state patterns. When the modified ADM is combined with entropy coding a 30-50% data compression can be realized.

Barba, J.↗

Deep space communications, weather effects, and error control

Deep space telemetry is and will remain signal-to-noise limited and vulnerable to interference. A need exists to increase received signal power and decrease noise. This includes going to Ka-band in the mid-1990's to increase directivity. The effects of a wet atmosphere can increase the noise temperature by a factor of 5 or more, even at X-band, but the order of magnitude increase in average data rate obtainable at Ka-band relative to X-band makes the increased uncertainty a good trade. Lowbit error probabilities required by data compression are available both theoretically and practically with coding, at an infinitesimal power penalty rather than the 10 to 15 dB more power required to reduce error probabilities without coding. Advances are coming rapidly in coding, as with the new constraint-length 15 rate 1/4 convolutional code concatenated with the already existing Reed-Solomon code to be demonstrated on Galileo. In addition, high density spacecraft data storage will allow selective retransmissions, even from the edge of the Solar System, to overcome weather effects. In general, deep space communication was able to operate, and will continue to operate, closer to theoretical limits than any other form of communication. These include limits in antenna area and directivity, system noise temperature, coding efficiency, and everything else. The deep space communication links of the mid-90's and beyond will be compatible with new instruments and compression algorithms and represent a sensible investment in an overall end-to-end information system design.

Posner, Edward C.↗

Method for coding low entrophy data

A method of lossless data compression for efficient coding of an electronic signal of information sources of very low information rate is disclosed. In this method, S represents a non-negative source symbol set, (s(sub 0), s(sub 1), s(sub 2), ..., s(sub N-1)) of N symbols with s(sub i) = i. The difference between binary digital data is mapped into symbol set S. Consecutive symbols in symbol set S are then paired into a new symbol set Gamma which defines a non-negative symbol set containing the symbols (gamma(sub m)) obtained as the extension of the original symbol set S. These pairs are then mapped into a comma code which is defined as a coding scheme in which every codeword is terminated with the same comma pattern, such as a 1. This allows a direct coding and decoding of the n-bit positive integer digital data differences without the use of codebooks.

Yeh, Pen-Shu↗

An algorithm for computing the number of distinct spectral vectors in thematic mapper data

A computationally efficient method was developed to compute the number of distinct spectral vectors and their frequency of occurrence in Landsat-4 Thematic Mapper (TM) data. The algorithm first partitions the image into spectrally disjoint subsets and then computes the frequency distribution of distinct spectral vectors within each subset from a multidimensional histogram. The overall frequency distribution is tabulated by accumulating the results from each subset. The number of distinct spectral vectors could be used as a measure of potential storage compaction of alternate data representations for data compression, or as a measure of information content in the comparison of spectral band combinations and/or spatial resolutions for an image. Results from processing three 512 x 512 pixel Landsat-4 TM images and one Landsat-4 Multispectral Scanner (MSS) image are presented as examples. An algorithm for computing the frequency distribution of distinct spectral vectors in MSS data is given in the Appendix.

Wharton, S. W.↗

Identification of visual evoked response parameters sensitive to pilot mental state

Systems analysis techniques were developed and demonstrated for modeling the electroencephalographic (EEG) steady state visual evoked response (ssVER), for use in EEG data compression and as an indicator of mental workload. The study focused on steady state frequency domain stimulation and response analysis, implemented with a sum-of-sines (SOS) stimulus generator and an off-line describing function response analyzer. Three major tasks were conducted: (1) VER related systems identification material was reviewed; (2) Software for experiment control and data analysis was developed and implemented; and (3) ssVER identification and modeling was demonstrated, via a mental loading experiment. It was found that a systems approach to ssVER functional modeling can serve as the basis for eventual development of a mental workload indicator. The review showed how transient visual evoked response (tVER) and ssVER research are related at the functional level, the software development showed how systems techniques can be used for ssVER characterization, and the pilot experiment showed how a simple model can be used to capture the basic dynamic response of the ssVER, under varying loads.

Zacharias, G. L.↗

Strength and equation of state of NaCl from radial x-ray diffraction

The strength and equation of state of NaCl were determined under nonhydrostatic compression up to 27 GPa using an energy-dispersive radial x-ray diffraction technique in a diamond-anvil cell using the lattice strain theory. Together with estimation of the high-pressure shear modulus, it is suggested that NaCl could support a maximum differential stress of 0.980 GPa at 22.6 GPa under uniaxial compression. The differential stress rapidly drops at 27.2 GPa due to the phase transition from B1 phase to B2 phase for NaCl. The hydrostatic compression data of B1 phase yield a bulk modulus K{sub 0} = 25.6(8) GPa and its pressure derivative K{sub 0}′ = 5.16(20) using Pt pressure scale. In addition, a comparative study of the observed pressures from Pt scale and ruby-fluorescence scale shows that the ruby-fluorescence pressures may reflect the lower stress state under nonhydrostatic compression compared with hydrostatic compression.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Image processing techniques and applications to the Earth Resources Technology Satellite program

The Earth Resources Technology Satellite system is studied, with emphasis on sensors, data processing requirements, and image data compression using the Fast Fourier and Hadamard transforms. The ERTS-A system and the fundamentals of remote sensing are discussed. Three user applications (forestry, crops, and rangelands) are selected and their spectral signatures are described. It is shown that additional sensors are needed for rangeland management. An on-board information processing system is recommended to reduce the amount of data transmitted.

Polge, R. J.↗

A neural net based architecture for the segmentation of mixed gray-level and binary pictures

A neural-net-based architecture is proposed to perform segmentation in real time for mixed gray-level and binary pictures. In this approach, the composite picture is divided into 16 x 16 pixel blocks, which are identified as character blocks or image blocks on the basis of a dichotomy measure computed by an adaptive 16 x 16 neural net. For compression purposes, each image block is further divided into 4 x 4 subblocks; a one-bit nonparametric quantizer is used to encode 16 x 16 character and 4 x 4 image blocks; and the binary map and quantizer levels are obtained through a neural net segmentor over each block. The efficiency of the neural segmentation in terms of computational speed, data compression, and quality of the compressed picture is demonstrated. The effect of weight quantization is also discussed. VLSI implementations of such adaptive neural nets in CMOS technology are described and simulated in real time for a maximum block size of 256 pixels.

Tabatabai, Ali↗

Comparative in situ X-ray Diffraction Study of San Carlos Olivine: Influence of Water on the 410 km Seismic Velocity Jump in Earth’s Mantle

A comparative study of the equation of states of hydrous (0.4 wt% H{sub 2}O) and anhydrous San Carlos olivine (<30 ppm H2O) was conducted using synchrotron X-rays up to 11 GPa in a diamond anvil cell (DAC) at ambient temperature. Both samples were loaded in the same high-pressure chamber of the DAC to eliminate the possible pressure difference in different experiments. The obtained compression data were fitted to the third-order Birch-Murnaghan equation of state, yielding a bulk modulus K{sub 0} = 123(3) GPa for hydrous olivine and K{sub 0} = 130(4) GPa for anhydrous olivine as K{sub 0}' is fixed at 4.6. Therefore, 0.4 wt% H{sub 2}2O in olivine results in a 5% reduction in bulk modulus. Previous studies reported bulk modulus reduction by water in olivine's high-pressure polymorph (wadsleyite), to which the transformation from olivine gives rise to the seismic discontinuity at 410 km depth. The new data results in a reduction in the magnitude of the discontinuity by 50% in v{sub P} and 30% in v{sub S} (for 1:5 water partitioning between olivine and wadsleyite) with respect to anhydrous mantle. Previous knowledge of the influence of water on this phase transition has been in opposition to a large amount of water [e.g., 200 ppm by Wood (1995)] existing at 410 km depth. Calculation of the seismic velocities based on newly available elasticity data of the hydrous phases indicates that the presence of water is favorable for the mineral composition model (pyrolite) and seismic observations in terms of the magnitude of the 410 km discontinuity.

58 GEOSCIENCES↗

Digital command system

The correct processing of the Digital Command System (DCS), which provides a limited real-time means of controlling specific flight program functions, was verified. The ability of the flight program to correctly read and process DCS commands was verified. Tests made by the flight program after reading the contents of the command decoder register to establish the validity of the received data were verified through the following: DCS mode command verification, DCS data command verification, DCS data validation, and DCS error message. The operation of the following DCS commands accepted and processed by the flight program was tested: time base update, navigation update, generalized switch selector, memory dump, terminate, execute generalized maneuver, return to nominal timeline, ECS water control valve logic inhibit, execute maneuver, execute alternate sequence, targeting load, ladder magnitude limit, S-IVB/IU de-orbit, compressed data dump, and remove inhibit on the extraction maneuver.

Source record↗