Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Quantifying the hierarchy of structural and mechanical length scales in granular systems

Continuum modeling of granular media is made possible by the existence of a length scale at and above which grain-resolved properties can be meaningfully homogenized. Progress has been made in identifying such length scales relevant to local structural properties such as porosity. However, a systematic analysis of scales above which different mechanical properties can be homogenized has yet to emerge. Here, X-ray tomography and 3D X-ray diffraction data are examined to identify such length scales. The data was obtained in-situ in compressed granular materials with rigid and flexible confinement. The experimental data are supplemented with validated discrete element simulations which examine different system sizes and different boundary conditions. Overall, our study reveals a hierarchy in the length scales of granular solids, with lengths governing structural variables being the shortest, lengths of stress variables being intermediate, and lengths of energy dissipation being the longest. All structural and mechanical length scales obey a power law based on the theory of Geostatistics, implying that the length scales can be found by analyzing samples significantly smaller than the length scales themselves. The length scales are also found to be sensitive to boundary conditions, implying that they are extrinsic features of granular media.

36 MATERIALS SCIENCE↗
NASA NTRS1984

The Solar Maximum observatory

The successful retrieval and repair of the Solar Maximum Mission (SMM) satellite by Shuttle astronauts in April 1984 permitted continuance of solar flare observations that began in 1980. The SMM carries a soft X ray polychromator, gamma ray, UV and hard X ray imaging spectrometers, a coronagraph/polarimeter and particle counters. The data gathered thus far indicated that electrical potentials of 25 MeV develop in flares within 2 sec of onset. X ray data show that flares are composed of compressed magnetic loops that have come too close together. Other data have been taken on mass ejection, impacts of electron beams and conduction fronts with the chromosphere and changes in the solar radiant flux due to sunspots.

Rust, D. M.↗
DOE OSTI2025

A Survey on Error-Bounded Lossy Compression for Scientific Datasets

Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide range of parallel and distributed use cases for years. They are designed with distinct compression models and principles, such that each of them features particular pros and cons. In this article, we provide a comprehensive survey of emerging error-bounded lossy compression techniques. The key contribution is fourfold. (1) We summarize a novel taxonomy of lossy compression into six classic models. (2) We provide a comprehensive survey of 10 commonly used compression components/modules. (3) We summarized pros and cons of 47 state-of-the-art lossy compressors and present how state-of-the-art compressors are designed based on different compression techniques. (4) We discuss how customized compressors are designed for specific scientific applications and use-cases. We believe this survey is useful to multiple communities including scientific applications, high-performance computing, lossy compression, and big data.

Error-Bounded Lossy Compression↗
NASA NTRS1972

Upper bound on compression ratio for run-length encoding.

Run-length encoding is a scheme which has been used to remove redundancy from video signals. Based upon a first-order Markov model of video data, an upper bound on compression ratio is found for run-length encoding. It is shown that at best run-length encoding will give a compression ratio which is approximately 60% of the maximum attainable value. This percentage is fairly independent of the particular picture involved.

Gray, K. G.↗
DOE OSTI2021

GPU-based Image Compression for Efficient Compositing in Distributed Rendering Applications

Visualizations of large-scale data sets are often created on graphics clusters that distribute the rendering task amongst many processes. When using real-time GPU-based graphics algorithms, the most time-consuming aspect of distributed rendering is typically the com-positing phase - combining all partial images from each rendering process into the final visualization. Compo siting requires image data to be copied off the GPU and sent over a network to other processes. While compression has been utilized in existing distributed rendering compositors to reduce the data being sent over the network, this compression tends to occur after the raw images are transferred from the GPU to main memory. In this paper, we present work that leverages OpenGL / CUDA interoperability to compress raw images on the GPU prior to transferring the data to main memory. This approach can significantly reduce the device-to-host data transfer time, thus enabling more efficient compositing of images generated by distributed rendering applications.

Lipinksi, Riley↗
NASA NTRS1985

Analysis of AIS Data of the Recluse Oil Field, Recluse, Wyoming

Airborne Imaging Spectrometer (AIS) data were flown over the Recluse, Wyoming oil field on September 9, 1984. Processing software was developed at Earth Satellite Corporation (EarthSat) for interactive analysis of the AIS data. EarthSat's AIS processing capabilities include destriping, solar irradiance corrections, residual calculations, geometric resampling, equal energy normalization, interactive spectral classifications and a variety of compressive algorithms to reduce the data to 8-bit format with a minimum of information loss. The in-house photolab facilities of EarthSat can routinely produce high-quality color renditions of the enhanced AIS data. A total of 80 lithologic samples were collected under the AIS flight lines. Correlation (within the atmospheric windows) between the laboratory and the AIS spectra of sample sites was generally poor. Reasonable correlation was only possible in large, freshly plowed fields. Mixed pixels and contrast between the natural and sample's surfaces were believed responsible for the poor correlation. Finally, a drift of approximately three channels was observed in the diffraction grating position within the 1.8 to 2.1 micron quadrant.

Dykstra, J. D.↗
NASA NTRS2017

Investigating Access Performance of Long Time Series with Restructured Big Model Data

Data sets generated by models are substantially increasing in volume, due to increases in spatial and temporal resolution, and the number of output variables. Many users wish to download subsetted data in preferred data formats and structures, as it is getting increasingly difficult to handle the original full-size data files. For example, application research users such as those involved with wind or solar energy, or extreme weather events are likely only interested in daily or hourly model data at a single point (or for a small area) for a long time period, and prefer to have the data downloaded in a single file. With native model file structures, such as hourly data from NASA Modern-Era Retrospective analysis for Research and Applications Version-2 (MERRA-2), it may take over 10 hours for the extraction of parameters-of-interest at a single point for 30 years. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is exploring methods to address this particular user need. One approach is to create value-added data by reconstructing the data files. Taking MERRA-2 data as an example, we have tested converting hourly data from one-day-per-file into different data cubes, such as one-month, or one-year. Performance is compared for reading local data files and accessing data through interoperable services, such as OPeNDAP. Results show that, compared to the original file structure, the new data cubes offer much better performance for accessing long time series. We have noticed that performance is associated with the cube size and structure, the compression method, and how the data are accessed. An optimized data cube structure will not only improve data access, but also may enable better online analysis services

reanalysis↗
NASA NTRS1993

Digital mammography, cancer screening: Factors important for image compression

The use of digital mammography for breast cancer screening poses several novel problems such as development of digital sensors, computer assisted diagnosis (CAD) methods for image noise suppression, enhancement, and pattern recognition, compression algorithms for image storage, transmission, and remote diagnosis. X-ray digital mammography using novel direct digital detection schemes or film digitizers results in large data sets and, therefore, image compression methods will play a significant role in the image processing and analysis by CAD techniques. In view of the extensive compression required, the relative merit of 'virtually lossless' versus lossy methods should be determined. A brief overview is presented here of the developments of digital sensors, CAD, and compression methods currently proposed and tested for mammography. The objective of the NCI/NASA Working Group on Digital Mammography is to stimulate the interest of the image processing and compression scientific community for this medical application and identify possible dual use technologies within the NASA centers.

Clarke, Laurence P.↗
NASA NTRS2020

Progressive Failure Analysis Correlation with Notched Composite Laminate Test Data

Testing of small and intermediate laminate panels with notches was performed and Progressive Failure Analyses (PFA) models were developed for aid in test planning and for correlation with the test data. Two progressive damage failure models were included in the study: the commercially available Abaqus built-in damage model and COmplete STress Reduction (COSTR) damage model developed at NASA Langley Research Center (LaRC). The finite elements models used for the analysis were developed using shell elements. The pre-test PFA results obtained from the two damage models were compared to test data. Then a post-test PFA with updated material properties based on additional available material property data was executed with the COSTR damage model and compared to the test data. The panels tested in compression all exhibited less scatter in the failure load with self-similar failure behavior. The panels tested in tension exhibited more scatter in the failure load with a failure mode that included delamination of plies. However, a self-similar crack path was also observed as the overall failure mode for all panels tested. When comparing test data to the pre-test analysis results, both damage models with shell element models were considered adequate for predicting the behavior and failure load of both the small and intermediate panels when tested in compression. However, for the tension load cases, larger differences were observed between the test and analysis results. When comparing test data to the post-test analysis performed using the COSTR damage model, better correlation was observed. However, large discrepancies were still observed for the tension load cases. Consequently, a higher fidelity finite element model including solid elements for sub-laminates and the modeling of cohesive layers between sub-laminate layers is recommended for tension loading of notched composite laminates.

Damage Model,Progressive Failure Analysis,Open Hol↗
NASA NTRS1972

Compression of transmission bandwidth requirements for a certain class of band-limited functions.

A study of source-encoding techniques that afford a reduction of data-transmission rates is made with particular emphasis on the compression of transmission bandwidth requirements of band-limited functions. The feasibility of bandwidth compression through analog signal rooting is investigated. It is found that the N-th roots of elements of a certain class of entire functions of exponential type possess contour integrals resembling Fourier transforms, the Cauchy principal values of which are compactly supported on an interval one N-th the size of that of the original function. Exploring this theoretical result, it is found that synthetic roots can be generated, which closely approximate the N-th roots of a certain class of band-limited signals and possess spectra that are essentially confined to a bandwidth one N-th that of the signal subjected to the rooting operation. A source-encoding algorithm based on this principle is developed that allows the compression of data-transmission requirements for a certain class of band-limited signals.

Smith, I. R.↗
NASA NTRS1992

Shock-induced transformations in the system NaAlSiO4-SiO2 - A new interpretation

New internally consistent interpretations of the phases represented by the high pressure phase shock wave data for an albite-rich rock, jadeite, and nepheline in the system NaAlSiO4-SiO2, are obtained using the results of static high pressure investigations, and the recent discovery of the hollandite phase in a shocked meteorite. We conclude that nepheline transforms directly to the calcium ferrite structure, whereas albite transforms possibly to the hollandite structure. Shock Hugoniots for the other plagioclase and alkali feldspars also indicate that these transform to hollandite structures. The pressure-volume data at high pressure could alternatively represent the compression of an amorphous phase. Moreover, the shock Hugoniot data are expected to reflect the properties of the melt above shock stresses of 60-80 GPa. The third order Birch-Murnaghan equation of state parameters are given for the calcium ferrite type NaAlSiO4 and for albite-rich, orthoclase-rich, and anorthite-rich hollandites.

Sekine, Toshimori↗
NASA NTRSDate not supplied

Latest Development in Radiative Transfer Models and Retrieval Algorithms Using Principal Components

The radiative transfer model (RTMs) has a wide range of applications in satellite remote sensing and atmospheric radiation applications. However, millions of line-by-line (LBL) radiative transfer calculations at fine monochromatic frequencies are needed in order to properly calculate spectral contributions of water vapor and trace gases in the atmosphere in infrared and solar spectral regions. Therefore, fast and accurate RTMs are needed to efficiently process large amount of satellite data. A Principal Component-based Radiative Transfer Model (PCRTM) was first developed in 2004 at NASA Langley Research Centre to fulfil this need. By using PC-compression, one can reduce the data dimension significantly while maintaining original information content. The PCRTM can directly compute PC-scores and their derivatives with respect to retrieved parameters. The PCRTM can simulate the top-of-atmosphere (TOA) radiance or reflectance spectra from 0.250 µm (400000 cm-1) to 2000 µm (50 cm-1) with several orders of magnitude faster speed as compared to a LBL RTM. It is also extremely accurate compared to LBL RTM benchmarks (0.03 K RMS error in IR and 0.05% in solar). The PCRTM model has been developed for hyperspectral sensors such as AIRS, CrIS, IASI, NAST-I, SHIS, FIRST, and CLARREO-IR in thermal IR spectral region and CLARREO-Solar, CPF, TEMPO, EMIT, OMI, and SCIAMACHY in solar spectral region. The PCRTM accuracy has been demonstrated via RTM intercomparisons and with real satellite observations from AIRS, CrIS, IASI, SCHIAMACHY, and EMIT etc. In this presentation, we will describe two PCRTM-based inversion algorithms to retrieve atmospheric temperature, water vapor, and trace gas profiles, as well as cloud and surface properties from hyperspectral sounders such as AIRS, CrIS, IASI, and NAST-I. The first one is called Single Fieldof-view Sounder Atmospheric Product (SiFSAP) algorithm. It provides L2 products with 9-times higher area spatial resolution as compared to current cloud-clearing sounder algorithms. The SiFSAP L2 and L3 products are available at NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) for public access. The second inversion algorithm is called Climate Fingerprinting Atmospheric Product (ClimFiSP) algorithm. It is designed to produce high quality climate products (trends, anomalies, daily, and monthly profiles of temperature, water vapor, traces, clouds, and surface properties) from multiple satellite sensors such AIRS on Aqua and CrIS on multiple satellites. This product will be available at NASA GES DISC later this year. The PCRTMbased high fidelity simulators for CLARREO and CPF have been used for sensor performance trade studies, algorithm development, and inter-satellite calibrations. We have also used PCRTM generated TOA radiance spectra to train an AI-based algorithm and successfully retrieved cloud properties from EMIT solar hyperspectral imagers.

PCRTM↗
NASA NTRS2003

Thermal Effects on the Compressive Behavior of IM7/PET15 Laminates

The effect of changing operating temperature on the compressive response of IM7/PETI5 composite laminates is investigated within this paper. The three temperatures evaluated for this study were 129 C, 21 C, and 177 C, a spectrum from cryogenic to an elevated operating temperature. Laminate compressive strength property testing was conducted using the Wyoming Combined Load Compression fixture to generate strength data at the three operating temperatures of interest for several lay-ups. A three-dimensional finite element analysis model of a [90/0]8s composite laminate subject to compressive loading is developed. The model is used to study the key attributes of the laminate that significantly influence the state of stress in the laminate. Both the resin rich layer located between lamina and the thermal residual stresses present in the laminate due to curing are included in the analysis model. For the laminate modeled, the effect of modeling temperature dependent material properties was determined to be insignificant for the operating temperatures studied. Simply using the material properties measured at the operating temperature of interest was sufficient for predicting stresses accurately in a linear analysis for the current problem. The three-dimensional analysis results revealed that the application of an applied compressive axial load in the 0-degree direction decreased the interlaminar stresses present in the laminate initially due to curing. Therefore, failure was concluded not be attributable to the interlaminar stresses in the composite laminate being studied when a compressive load is applied. The magnitude of the measured laminate compressive strength change with a change in temperature is concluded to be dominated by the change in the lamina compressive axial strength with a change in temperature.

Walker, Sandra Polesky↗
DOE OSTI2024

Investigation of fast and efficient lossless compression algorithms for macromolecular crystallography experiments

Structural biology experiments benefit significantly from state-of-the-art synchrotron data collection. One can acquire macromolecular crystallography (MX) diffraction data on large-area photon-counting pixel-array detectors at framing rates exceeding 1000 frames per second, using 200 Gbps network connectivity, or higher when available. In extreme cases this represents a raw data throughput of about 25 GB s −1 , which is nearly impossible to deliver at reasonable cost without compression. Our field has used lossless compression for decades to make such data collection manageable. Many MX beamlines are now fitted with DECTRIS Eiger detectors, all of which are delivered with optimized compression algorithms by default, and they perform well with current framing rates and typical diffraction data. However, better lossless compression algorithms have been developed and are now available to the research community. Here one of the latest and most promising lossless compression algorithms is investigated on a variety of diffraction data like those routinely acquired at state-of-the-art MX beamlines.

36 MATERIALS SCIENCE↗
NASA NTRS1975

Effect of afterburner lights and inlet unstarts on a mixed compression inlet turbofan engine operating at Mach 2.5

Data are presented to show the response of an uncontrolled inlet to afterburner lightoff disturbances when a mixed-compression inlet is coupled to a turbofan engine. The results show a significant upstream shock excursion when the afterburner lights which is a result of the direct communication between the afterburner region and the inlet by means of the fan duct and fan stages. In addition results of a waveform analysis on the inlet pressure response to the afterburner light is presented. Inlet unstarts and their effect on operation of the propulsion system is also discussed.

Baumbick, R. J.↗
DOE OSTI2026

Cosmological constraints from a joint DESI DR1 Full-Shape and DR2 BAO

We present a cosmological analysis combining full-shape (FS) clustering measurements from the Dark Energy Spectroscopic Instrument (DESI) DR1 with baryon acoustic oscillation (BAO) measurements from DESI DR2. To achieve a robust combination that accounts for the correlation between the two data releases, we employ the ShapeFit compression method and estimate the joint covariance using EZmocks. This compressed approach inherently mitigates the prior volume effects that have previously dominated Bayesian constraints from DESI data with minimal external priors. Consequently, we obtain — for the first time within a Bayesian framework — reliable DESI-only constraints on extensions to ΛCDM using only a Big Bang Nucleosynthesis prior on the baryon density and a wide prior on the spectral index. In flat ΛCDM, we find Ω m = 0.3035 ± 0.0085, h = 0.6876 ± 0.0059, and σ 8 = 0.822 ± 0.034. For the w 0 w a CDM dynamical dark energy model, we measure w 0 = -0.49 ± 0.25 and w a = -1.52 ± 0.77, improving constraints by ∼ 30% relative to the analogous DR1 measurement and reducing the discrepancy with ΛCDM to 1.4σ when compared to BAO only analyses. We also report competitive limits on the sum of neutrino masses and spatial curvature. This work demonstrates that the ShapeFit compression provides a prior-robust and computationally efficient pathway to constrain beyond-ΛCDM physics with large-scale structure.

baryon acoustic oscillations↗
NASA NTRS1981

A new architecture for adaptive transform compression of NTSC composite video signal

In orthogonal transform coding of NTSC video signal, the data is processed in blocks. Processing a block of data that is maximally correlated leads to larger compression. This paper describes a new architecture for arranging the pixels in a block that yields higher correlation than the adjacent pixel blocks. The data is processed using adaptive, intrafield, discrete cosine transform, variable bit allocation coding. In subjective tests, the picture quality was good for an average of about 2 bits/pel for intrafield processing.

Ekambaram, C.↗
NASA NTRS2006

Probabilistic Classification Using Elemental Abundance Distributions and Lossless Image Compression in Apollo 17 Lunar Dust Samples from Mare Serenitatis

We have previously outlined a strategy for the detection of fossils [Storrie-Lombardi and Hoover, 2004] and extant microbial life [Storrie-Lombaudi and Hoover, 20051 during robotic missions to Mars using co-registered structural and chemical signatures. Data inputs included image lossless compression indices to estimate relative textural complexity and elemental abundance distributions. Two exploratory classification algorithms (principal component analysis and hierarchical cluster analysis) provide an initial tentative classification of all targets. Nonlinear stochastic neural networks are then trained to produce a Bayesian estimate of algorithm classification accuracy. The strategy previously has been successful in distinguishing regions of biotic and abiotic alteration of basalt glass from unaltered samples. [Storrie-Lombardi and Fisk, 2004; Storrie-Lombardi and Fisk, 2004] Such investigations of abiotic versus biotic alteration of terrestrial mineralogy on Earth are compromised by .the difficulty finding mineralogy completely unaffected by the ubiquitous presence of microbial life on the planet. The renewed interest in lunar exploration offers an opportunity to investigate geological materials that may exhibit signs of aqueous alteration, but are highly unlikely to contain contaminating biological weathering signatures. We here present an extension of our earlier data set to include lunar dust samples obtained during the Apollo 17 mission. Apollo 17 landed in the Taurus-Littrow Valley in Mare Serenitatis. Most of the rock samples from this region of the lunar highlands are basalts comprised primarily of plagioclase and pyroxene and selected examples of orange and black volcanic glass. SEM images and elemental abundances (C6, N7, O8, Na11, Mg12, Al13, Si14, P15, S16, Cll7, K19, Ca20, Fe26) for a series of targets in the lunar dust samples are compared to the extant cyanobacteria, fossil trilobites, Orgueil meteorite, and terrestrial basalt targets previously discussed. The data set provides a first step in producing a quantitative probabilistic methodology for geobiological analysis of returned lunar samples or in situ exploration.

Storrie-Lombardi, Michael C.↗