Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Synthetic Streamflow Datasets to Support Emulation of Water Allocations via LSTM

This archive is the data companion to the bonney_et-al_2026_erc metarepo which generates synthetic data, trains an LSTM model, and generates performance metrics on the trained model. While the generation of the synthetic data is fully reprodicible, it is a computationally expensive process. This data archive contains the synthetic datasets needed for training and testing an LSTM model and reproduction of figures and tables. In addition, supplemenatary data products generating and visualizing results is also included, such as geospatial data for the basin. Contents There are two high level directories: `WRAP_archive/` and `repo_data/`. The `WRAP_archive` directory contains compressed intermediate dataproducts from the dataset generation workflow (marked as "I_Dataset_Generation" in the metarepo). These data products are not required by any scripts in the metarepo, but they are archived as they are expensive to generate and may have useful information for other analyses. The `repo_data` directory contains the necessary data for reproducing the workflow in the metarepo and should be decompressed and moved into the top level of the metarepo. Additional details are provided in README.md.

drought↗

Can Pseudobreakups be Predicted?

We statistically analyze many interplanetary shock events where there are both WIND interplanetary data and POLAR UV imaging data. We find that the shock compression events trigger pseudobreakups (PBs), substorm onsets, or enhance (pre-existing) substorm intensities. Using WIND interplanetary data and ground-based data, it is now believed that we can predict when PBs will occur and when substorm expansion phases will occur.

Zhou, X.-Y.↗

ZFP Hardware Implementation

As core counts increase in new HPC systems with comparatively little increase in memory bandwidth, the trend is an effective decrease in memory bandwidth per core. Other bandwidth limitations in HPC systems exist between CPU and GPU memory, between system nodes, and between node memory and storage. Compression of floating-point data has the potential to reduce data movement and pressure across these communication channels. Furthermore, it has the potential to reduce the footprint of floating-point arrays stored in memory. ZFP, implemented in software, is gaining traction as an effective method in floating-point compression; however, performance gains are limited to the spare compute cycles available before reaching the bandwidth limitations of the communication channel. A hardware implementation of ZFP has the potential to raise the bar on performance. From the inception of ZFP, it was designed to accommodate a hardware implementation.

42 ENGINEERING↗

Leafweb: Dataset in Support of Coupled Modeling of Photophysics, Photochemistry, and Biochemistry of Photosynthesis, December 2022 Release

This data set contains measurements of leaf gas exchange and Pulse-Amplitude Modulated (PAM) fluorometry of light, carbon dioxide (CO2), oxygen (O2), and temperature responses from 26 C3 photosynthetic and four C4 photosynthetic species measured by independent researchers in Canada, China, Finland, Netherlands, and United States in the field, garden, or greenhouse. Data were collected between 1987 and 2021, however data for individual species only provide coverage over a few hours to one year. Species include three lianas, three shrubs, two boreal deciduous trees, two boreal evergreen needle-leaf tree, three temperate deciduous trees, four tropical deciduous trees, three tropical evergreen trees, one C3 grass, three C4 grasses, and six crop varieties. These measurements are conducted according to standard protocols in gas exchange (Long and Bernacchi 2003) and PAM fluorometry (Baker 2008). The Scots pine (Pinus sylvestris) dataset contains one-year continuous fluorometry observations made at intervals of 10 or 30 minutes in the field under natural environments using Walz monitoring PAM. Measurements from all other 29 species include simultaneous PAM fluorometry and gas exchange observations. Among these 29 species, seven species were measured with light response curves only (i.e., light intensity varied systematically with ambient CO2 concentration controlled at a constant level, e.g., 400 ppm). All the other 22 species were measured with both the light response and CO2 response (i.e., ambient CO2 concentration varied systematically with light intensity controlled at a constant level, e.g., 1200 µmolm-2s-1). For most species, measurements were made with temperature controlled at ~ 25 degrees Celsius (C) with the exceptions of Scots pine (natural diurnal and seasonal variations), tomato cultivar Basket Vee (~ 21 degrees C), and cotton which contained temperature stress experiments (9 to 40 degrees C). All measurements were made at ambient O2 concentration except for the tomato cultivar Basket Vee and cotton which used two O2 levels (2 and 21%) and rice and tomato cultivar Growdena which used five O2 levels (2, 10, 21, 35, and 50%). This dataset supports the complete modeling of photosynthesis at the leaf scale, including photophysical, photochemical, and biochemical reactions. It will support research in the applications of remotely sensed solar induced chlorophyll fluorescence and the responses of energy dissipation pathways to environmental variations across species and climates. This dataset contains 260 data files in comma separate (.csv) format contained inside 11 compressed (*.zip) files. Additional metadata are provided: one data dictionary, a species information table, and a file-level metadata file in comma separate (.csv) format and a user guide in PDF (*.pdf) format.

air temperature↗

Pressure-induced structures of Si-doped HfO{sub 2}

The effect of hydrostatic pressure on the structure of Si-doped HfO{sub 2} (Si:HfO{sub 2}) was studied by using a diamond anvil cell in combination with high-energy X-ray diffraction at a synchrotron source. Diffraction data were measured in situ during compression up to pressures of 31 GPa. Si:HfO{sub 2} with 3, 5, and 9 at. % Si were found to undergo a monoclinic to orthorhombic transition at pressures between 7 and 15 GPa. Whole pattern analysis was carried out using nonpolar (Pbca) and polar (Pca2{sub 1}) crystallographic models to investigate the symmetry of the observed high-pressure orthorhombic phase. Rietveld refinement results cannot discriminate a reliable difference between the Pbca and Pca2{sub 1} structures as they nearly equally model the measured diffraction data. The pressure dependent lattice parameters, relative volume, and spontaneous strain are reported.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Contextual Compression of Large-Scale Wind Turbine Array Simulations

Data sizes are becoming a critical issue particularly for HPC applications. We have developed a user-driven lossy wavelet-based storage model to facilitate the analysis and visualization of large-scale wind turbine array simulations. The model stores data as heterogeneous blocks of wavelet coefficients, providing high-fidelity access to user-defined data regions believed the most salient, while providing lower-fidelity access to less salient regions on a block-by-block basis. In practice, by retaining the wavelet coefficients as a function of feature saliency, we have seen data reductions in excess of 94 percent, while retaining lossless information in the turbine-wake regions most critical to analysis and providing enough (low-fidelity) contextual information in the upper atmosphere to track incoming coherent turbulent structures. Our contextual wavelet compression approach has allowed us to deliver interative visual analysis while providing the user control over where data loss, and thus reduction in accuracy, in the analysis occurs. We argue this reduced but contextualized representation is a valid approach and encourages contextual data management.

97 MATHEMATICS AND COMPUTING↗

Burst-Compression And -Expansion For TDMA Communication

Burst-compression and -expansion technique enables interconnection of users transmitting and receiving data at rates asynchronous with respect to clocks within ground terminals of satellite-switched, time-division-multiple-access (TDMA) communication network. Matrix switch aboard satellite routes bursts of data from source users received on uplink antennas to downlink antennas illuminating ground areas containing destination users. TDMA ground terminal compresses streams of data from source users into rapid bursts for transmission and reexpands bursts of received data into slower streams of data for delivery to destination users. Greater flexibility in interconnecting widely dispersed users achieved by use of hopping beams.

Budinger, James M.↗

Apparatus for measuring strength in biaxial compression

We report most measurements of compressive strength of ductile materials have involved Hopkinson–Kolsky bars or Taylor anvils placing samples in uniaxial compression. In these geometries, strain is limited by the tendency of the sample to petal, in analogy to necking in uniaxial tension. Estimation of strength for any other form of the stress tensor requires assuming a shape of the yield surface; because data exist only for uniaxial compression, these assumptions are untested. In an imploding spherical shell, compression is biaxial, the plastic strain may not be small, and the material behavior may be nonlinear as a result of work hardening and heating by plastic work. We outline a method of measuring the strengths of materials in biaxial compression, both quasistatically and dynamically, using the compression of thin spherical shells. We suggest surrounding the shell with an annulus filled with a mixture of H 2 and Cl 2 gases whose homogeneous ignition is initiated by a flash of blue and near-ultraviolet light. Less promising approaches are described in Appendixes A–C .

47 OTHER INSTRUMENTATION↗

A simple method of calculating power-law velocity profile exponents from experimental data

Analytical expressions for the effects of compressibility and heat transfer on laminar and turbulent shape factors H have been developed. Solving the turbulent equation for the power law velocity profile exponent N has resulted in a simple technique by which the N values of experimental turbulent profiles can be calculated directly from the integral parameters. Thus the data plotting, curve fitting, and slope measuring, which is the normal technique of obtaining experimental N values, is eliminated. The N values obtained by this method should be within the accuracy with which they could be measured.

Allen, J. M.↗

Autonomous Image Analysis for Future Mars Missions

To explore high priority landing sites and to prepare for eventual human exploration, future Mars missions will involve rovers capable of traversing tens of kilometers. However, the current process by which scientists interact with a rover does not scale to such distances. Specifically, numerous command cycles are required to complete even simple tasks, such as, pointing the spectrometer at a variety of nearby rocks. In addition, the time required by scientists to interpret image data before new commands can be given and the limited amount of data that can be downlinked during a given command cycle constrain rover mobility and achievement of science goals. Experience with rover tests on Earth supports these concerns. As a result, traverses to science sites as identified in orbital images would require numerous science command cycles over a period of many weeks, months or even years, perhaps exceeding rover design life and other constraints. Autonomous onboard science analysis can address these problems in two ways. First, it will allow the rover to preferentially transmit "interesting" images, defined as those likely to have higher science content. Second, the rover will be able to anticipate future commands. For example, a rover might autonomously acquire and return spectra of "interesting" rocks along with a high-resolution image of those rocks in addition to returning the context images in which they were detected. Such approaches, coupled with appropriate navigational software, help to address both the data volume and command cycle bottlenecks that limit both rover mobility and science yield. We are developing fast, autonomous algorithms to enable such intelligent on-board decision making by spacecraft. Autonomous algorithms developed to date have the ability to identify rocks and layers in a scene, locate the horizon, and compress multi-spectral image data. We are currently investigating the possibility of reconstructing a 3D surface from a sequence of images acquired by a robotic arm camera. This would then allow the return of a single completely in focus image constructed only from those portions of individual images that lie within the camera's depth of field. Output from these algorithms could be used to autonomously obtain rock spectra, determine which images should be transmitted to the ground, or to aid in image compression. We will discuss these algorithms and their performance during a recent rover field test.

Gulick, V. C.↗

Automatic Aircraft Collision Avoidance System and Method

The invention is a system and method of compressing a DTM to be used in an Auto-GCAS system using a semi-regular geometric compression algorithm. In general, the invention operates by first selecting the boundaries of the three dimensional map to be compressed and dividing the three dimensional map data into regular areas. Next, a type of free-edged, flat geometric surface is selected which will be used to approximate terrain data of the three dimensional map data. The flat geometric surface is used to approximate terrain data for each regular area. The approximations are checked to determine if they fall within selected tolerances. If the approximation for a specific regular area is within specified tolerance, the data is saved for that specific regular area. If the approximation for a specific area falls outside the specified tolerances, the regular area is divided and a flat geometric surface approximation is made for each of the divided areas. This process is recursively repeated until all of the regular areas are approximated by flat geometric surfaces. Finally, the compressed three dimensional map data is provided to the automatic ground collision system for an aircraft.

Skoog, Mark↗

A SAR correlation algorithm which accommodates large-range migration

This paper presents an algorithm for azimuth correlation of synthetic aperture radar (SAR) data with extraordinarily large-range migration which cannot be accommodated by the existing frequency domain interpolation approach used in current Seasat SAR processing. A mathematical model is provided for the SAR range-correlated point-target response both in the spatial and frequency domains. A simple and efficient processing algorithm derived from the exact two-dimensional correlation algorithm is given. This algorithm enables azimuth correlation by two cascaded one-dimensional correlation steps. The first step is to transform the range-correlated SAR data into the frequency domain in azimuth, followed by a newly developed range convolution filter to correct the range-dispersed spectrum of the range-correlated point-target response (RCPTR). The second step is the frequency-domain range migration correction approach for the azimuth compression. Simulation results provided here indicate that this processing algorithm yields a satisfactory compressed impulse response for SAR data with large-range migration whereas previous methods were subject to a broadening of the impulse response along range.

Jin, M. Y.↗

Leafweb: Leaf Gas Exchange and Pulse-Amplitude Modulated Fluorometry for C4 Species, June 2026 Release

This dataset contains leaf gas exchange and Pulse-Amplitude Modulated (PAM) fluorometry for 98 C4 species. The C4 photosynthetic pathway employs specialized CO2 concentration mechanisms and Kranz anatomy to enrich CO2 concentration around Rubisco, the enzyme that catalyzes carbon fixation in the Calvin-Benson cycle to suppress photorespiration and increase the use efficiencies of light, nitrogen, and water as compared to the C3 photosynthetic pathways. Large-scale C4 photosynthetic datasets are relatively scarce, which has affected C4 photosynthesis research. To improve C4 photosynthetic data availability, Leafweb organized an effort to systematically collect, compile, standardize, and organize measurements of leaf gas exchange and/or Pulse-Amplitude Modulated (PAM) fluorometry of C4 species. This derived a C4 photosynthetic dataset containing measurements made by independent researchers in multiple countries in various environments (field, garden, or greenhouse). It covers three biochemical subtypes – the nicotinamide adenine dinucleotide phosphate-malic enzyme (NADP-ME), nicotinamide adenine dinucleotide-malic enzyme (NAD-ME), and phosphoenolpyruvate carboxykinase (PEP-CK) subtypes. This dataset is useful for using Artificial Intelligence / Machine Learning and mechanistic models to study C4 photosynthesis and compare across different biochemical subtypes. This dataset contains 3 compressed (*.zip) folders containing 1,892 data files in comma-separate values (*.csv) format. Additional metadata are provided: one data dictionary and a file-level metadata file in comma-separate values (*.csv) format and a user guide in PDF (*.pdf) format.

Zhou, Haoran [Tianjin University, China]↗

Shear strength measurements and hydrostatic compression of rhenium diboride under high pressures

Shear strength measurements have been carried out on rhenium diboride, ReB 2 , to a pressure of 74 GPa using a Radial X-ray Diffraction (R-XRD) technique in a diamond anvil cell using platinum as an internal x-ray pressure standard. The R-XRD result has provided a unique insight into the deformation of hexagonal crystal lattice under non-hydrostatic compression and variation of shear strength with increasing pressure. From R-XRD data, we have estimated hydrostatic component of compression to determine an equation of state of rhenium diboride yielding a bulk modulus of K 0 = 366 ± 25 GPa with a pressure derivative $K^{'}_{0}$ = 4.3 ± 0.5 in good agreement with hydrostatic density functional theory calculations. Here, the average lower bound of shear strength (τ) from various diffraction planes was then calculated using the measured interplanar d-spacing (d m ) and hydrostatic component of d-spacing (d p ) to be shown to approach 6.7 ± 0.4 GPa at 70 GPa. Our results show that the anisotropic compression effects observed in ReB 2 under hydrostatic compression are correlated to electronic structure changes under compression as predicted by theoretical calculations.

36 MATERIALS SCIENCE↗

Incorporation of market signals for the optimal design of post combustion carbon capture systems

Recent studies have shown that fossil generators equipped with post-combustion carbon capture (PCC) systems are needed to reduce the cost of deep decarbonization. Such generators need to be flexible and responsive to grid conditions, particularly in a high variable renewable energy (VRE) environment. In this work, we evaluate the net present value (NPV) of retrofitting an existing natural gas combined cycle (NGCC) unit with a flexible PCC system while incorporating market signals from a high VRE grid. We use our industrial partner’s NGCC configuration as representative of existing NGCC units and Svante’s rapid-temperature swing adsorption (TSA) for PCC. Because of its ability to rapidly startup/shutdown and ramp-up/ramp-down, the chosen capture technology is very attractive for load-following operations. For a given set of market signals, we formulate a two-stage stochastic multi-period optimization problem, under the price-taker assumption, to simultaneously optimize the design of the capture system and operation of the entire plant. Rigorous models for the NGCC unit, PCC system, and compression system are developed using commercial process simulators and validated with either plant or vendor data. For computational tractability, we develop surrogate/reduced-order models for use in the optimization problem. The surrogate model for the NGCC plant is constructed by linearizing the rigorous dynamic model at 75% load, while data-driven nonlinear surrogate models for the capture and compression systems are constructed using simulation data from the rigorous models. The optimization problem, formulated as a mixed integer bilinear program, is implemented in the IDAES® integrated platform and solved to global optimality using Gurobi 9.5. Using this formulation, we determine the profitability of retrofitting an existing NGCC unit with the chosen capture system for multiple regions in the U.S. under two scenarios with different carbon prices. Importantly, the results show that the optimal decision strongly depends on the region and on the carbon price, thereby demonstrating the importance of the inclusion of market signals in the design process.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Comparative analysis of nonlinear dimensionality reduction techniques for breast MRI segmentation

Purpose: Visualization of anatomical structures using radiological imaging methods is an important tool in medicine to differentiate normal from pathological tissue and can generate large amounts of data for a radiologist to read. Integrating these large data sets is difficult and time-consuming. A new approach uses both supervised and unsupervised advanced machine learning techniques to visualize and segment radiological data. This study describes the application of a novel hybrid scheme, based on combining wavelet transform and nonlinear dimensionality reduction (NLDR) methods, to breast magnetic resonance imaging (MRI) data using three well-established NLDR techniques, namely, ISOMAP, local linear embedding (LLE), and diffusion maps (DfM), to perform a comparative performance analysis. Methods: Twenty-five breast lesion subjects were scanned using a 3T scanner. MRI sequences used were T1-weighted, T2-weighted, diffusion-weighted imaging (DWI), and dynamic contrast-enhanced (DCE) imaging. The hybrid scheme consisted of two steps: preprocessing and postprocessing of the data. The preprocessing step was applied for B{sub 1} inhomogeneity correction, image registration, and wavelet-based image compression to match and denoise the data. In the postprocessing step, MRI parameters were considered data dimensions and the NLDR-based hybrid approach was applied to integrate the MRI parameters into a single image, termed the embedded image. This was achieved by mapping all pixel intensities from the higher dimension to a lower dimensional (embedded) space. For validation, the authors compared the hybrid NLDR with linear methods of principal component analysis (PCA) and multidimensional scaling (MDS) using synthetic data. For the clinical application, the authors used breast MRI data, comparison was performed using the postcontrast DCE MRI image and evaluating the congruence of the segmented lesions. Results: The NLDR-based hybrid approach was able to define and segment both synthetic and clinical data. In the synthetic data, the authors demonstrated the performance of the NLDR method compared with conventional linear DR methods. The NLDR approach enabled successful segmentation of the structures, whereas, in most cases, PCA and MDS failed. The NLDR approach was able to segment different breast tissue types with a high accuracy and the embedded image of the breast MRI data demonstrated fuzzy boundaries between the different types of breast tissue, i.e., fatty, glandular, and tissue with lesions (>86%). Conclusions: The proposed hybrid NLDR methods were able to segment clinical breast data with a high accuracy and construct an embedded image that visualized the contribution of different radiological parameters.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Effect of shear strength on Hugoniot-compression curve and the equation of state of tungsten (W)

The Hugoniot data for highly dense polycrystalline tungsten were obtained for pressures above 200 GPa, and the equation of state (EOS) was determined taking into account shear strength effects. For this study, we have made some improvements in measurement system and analyses of the shock wave data. Symmetric-impact Hugoniot measurements were performed using the high-time resolution streak camera system equipped on a one-stage powder gun and two-stage light gas gun, where the effects of tilting and bowing of flyer plate on the Hugoniot data were carefully considered. The shock velocity–particle velocity (U{sub S}–U{sub P}) Hugoniot relation in the plastic regime was determined to be U{sub S} = 4.137 + 1.242U{sub P} km/s (U{sub P} < 2 km/s). Ultrasonic and Velocity Interferometer System for Any Reflector measurements were also performed in this study. The zero-intercept value of the U{sub S}–U{sub P} Hugoniot relation was found to be slightly larger than the ultrasonic bulk sound velocity (4.023 km/s). The hypothetical hydrostatic isothermal U{sub s}–U{sub p} Hugoniot curve, which corresponds to the hydrostatic isothermal compression curve derived from the Hugoniot data using the strength data, converged to the bulk sound velocity, clearly showing shear strength dependence in the Hugoniot data. The EOS for tungsten is derived from the hydrostatic isothermal compression curve using the strength data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Development of a fast framing detector for electron microscopy

A high frame rate detector system is described that enables fast real-time data analysis of scanning diffraction experiments in scanning transmission electron microscopy (STEM). This is an end-to-end development that encompasses the data producing detector, data transportation, and real-time processing of data. The detector will consist of a central pixel sensor that is surrounded by annular silicon diodes. Both components of the detector system will synchronously capture data at almost 100 kHz frame rate, which produces an approximately 400 Gb/s data stream. Low-level preprocessing will be implemented in firmware before the data is streamed from the National Center for Electron Microscopy (NCEM) to the National Energy Research Scientific Computing Center (NERSC). Live data processing, before it lands on disk, will happen on the Cori supercomputer and aims to present scientists with prompt experimental feedback. This online analysis will provide rough information of the sample that can be utilized for sample alignment, sample monitoring and verification that the experiment is set up correctly. Only a compressed version of the relevant data is then selected for more in-depth processing.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗