Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Solving protein structure from sparse serial microcrystal diffraction data at a storage-ring synchrotron source

In recent years, the success of serial femtosecond crystallography and the paucity of beamtime at X-ray free-electron lasers have motivated the development of serial microcrystallography experiments at storage-ring synchrotron sources. However, especially at storage-ring sources, if a crystal is too small it will have suffered significant radiation damage before diffracting a sufficient number of X-rays into Bragg peaks for peak-indexing software to determine the crystal orientation. As a consequence, the data frames of small crystals often cannot be indexed and are discarded. Introduced here is a method based on the expand–maximize–compress (EMC) algorithm to solve protein structures, specifically from data frames for which indexing methods fail because too few X-rays are diffracted into Bragg peaks. The method is demonstrated on a real serial microcrystallography data set whose signals are too weak to be indexed by conventional methods. In spite of the daunting background scatter from the sample-delivery medium, it was still possible to solve the protein structure at 2.1 Å resolution. The ability of the EMC algorithm to analyze weak data frames will help to reduce sample consumption. Furthermore, it will also allow serial microcrystallography to be performed with crystals that are otherwise too small to be feasibly analyzed at storage-ring sources.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2024

Time-resolved X-ray diffraction diagnostic development for the National Ignition Facility

Here we present the development of an experimental platform that can collect four frames of x-ray diffraction data along a single line of sight during laser-driven, dynamic-compression experiments at the National Ignition Facility. The platform is comprised of a diagnostic imager built around ultrafast sensors with a 2-ns integration time, a custom target assembly that serves also to shield the imager, and a 10-ns duration, quasi-monochromatic x-ray source produced by laser-generated plasma. We demonstrate the performance with diffraction data for Pb ramp compressed to 150 GPa and illuminated by a Ge x-ray source that produces ∼7 × 10 11 , 10.25-keV photons/ns at the 400 μm diameter sample.

36 MATERIALS SCIENCE↗
DOE OSTI2021

The Cost of Decarbonization and Energy Upgrade Retrofits for US Homes

Cost is a major barrier when upgrading homes to reduce carbon emissions required to meet DOE’s climate-related goals. This report summarizes a nationwide effort to gather home energy upgrade project cost data along with household energy performance data. The goal was to develop cost benchmarks and to guide future R&D efforts aimed at cost compression and scaling of the residential upgrade market. The cost data were compiled for both total project costs and costs of individual measures. The majority of energy savings were modeled, with some models using measured site data for calibration. The database was analyzed using clustering techniques to find common energy and CO2 reduction approaches. The individual measures were combined into archetypal solutions to determine least-cost approaches to maximizing energy and carbon savings. Several financial analyses were preformed to examine other cost metrics beyond first cost. Project data was obtained for 1,739 projects, from 15 states and 12 energy programs, with a total of 10,512 individual measures. The database includes a wide-array of projects, ranging from single-measure HVAC upgrades to net-zero energy whole home remodels. Projects were predominantly single-family detached dwellings with wood frame construction. Most of the data was obtained from energy programs because they had recorded the necessary information and were willing to share with this study. This sample of convenience can provide broad guidance and national cost benchmarks, but lacks sufficient detail to draw more disaggregated conclusions, such as geographical trends. The majority of data contributions were obtained without compensation from sources where the required data was already in some sort of structured format. We compensated sources to enter data from individual projects into a structured data format for about 500 projects, with an average cost of about $40 per project. The database was highly skewed to lower cost, lower impact projects due to the nature of the sample of convenience. Less than 10% of projects had savings greater than 50%. The cost data for individual measures in the database are being used in other DOE efforts on residential energy use/decarbonization. This data collection effort should continue in order to provide the best-informed guidance for DOE and industry R&D, as well as deployment efforts (including policy and program planning).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

An Adaptable Seismic Data Format

We present ASDF, the Adaptable Seismic Data Format, a modern and practical data format for all branches of seismology and beyond. The growing volume of freely available data coupled with ever expanding computational power opens avenues to tackle larger and more complex problems. Current bottlenecks include inefficient resource usage and insufficient data organization. Properly scaling a problem requires the resolution of both these challenges, and existing data formats are no longer up to the task. ASDF stores any number of synthetic, processed or unaltered waveforms in a single file. A key improvement compared to existing formats is the inclusion of comprehensive meta information, such as event or station information, in the same file. Additionally, it is also usable for any non-waveform data, for example, cross-correlations, adjoint sources or receiver functions. Last but not least, full provenance information can be stored alongside each item of data, thereby enhancing reproducibility and accountability. Any data set in our proposed format is self-describing and can be readily exchanged with others, facilitating collaboration. The utilization of the HDF5 container format grants efficient and parallel I/O operations, integrated compression algorithms and check sums to guard against data corruption. To not reinvent the wheel and to build upon past developments, we use existing standards like QuakeML, StationXML, W3C PROV and HDF5 wherever feasible. Usability and tool support are crucial for any new format to gain acceptance. We developed mature C/Fortran and Python based APIs coupling ASDF to the widely used SPECFEM3D_GLOBE and ObsPy toolkits.

58 GEOSCIENCES↗
DOE OSTI2025

Data from: 'Abiotic influences on continuous conifer forest structure across a subalpine watershed'

This package archives the core data used for analysis and inference in 'Abiotic influences on continuous conifer forest structure across a subalpine watershed' (Worsham et al., 2025). All data were collected in the East River, Washington Gulch, Slate River, and Coal Creek watersheds of Colorado. In the paper, we quantified the relative influence of climate, topographic, edaphic, and geologic factors on conifer stand structure and composition, and their functional relationships, at the watershed scale. We used waveform LiDAR data to derive spatially continuous stand structure metrics. We fused these with a species-level classification map to estimate tree species abundance. We applied generalized additive and generalized boosted models to evaluate the covariability of structural and compositional metrics with abiotic variables. The package contains the essential products required for reproducing our analysis and the tables and figures reported in the publication. The products comprise four classes: (1) geospatial data, (2) tabular data used for inferential analysis, (3) tabular data describing analytical results and performance statistics, and (4) a data user guide. (1) includes discretized waveform LiDAR data, locations and attributes of individual tree crowns, sampling locations and domain boundaries, a canopy height model, and raster files of estimated forest structural and compositional metrics at 100 m grid scale. (2) includes all response and explanatory variable values applied in inferential models. Response variables include conifer forest stand density, basal area, 95th percentile height, quadratic mean diameter, and others. Explanatory variables include climatic water deficit, actual evapotranspiration, elevation, heat load, soil available water content, and others. (3) includes results of training and testing several individual tree detection (ITD) algorithms, as well as inferential modeling results. (4) is a PDF user guide for this data package, including detailed descriptions and data dictionaries for all files. The data package root contains 17 assets: 8 compressed tape archive (.tar.gz) files, 5 comma-separated values (.csv) files, 3 Geographic Tagged Image File Format (GeoTIFF) (.tif) files, and 1 Portable Document Format (.pdf) file. The compressed .tar.gz archives contain ESRI shapefiles (.shp) .tif, compressed LASer (.laz), and .csv files. The archives must first be decompressed using the widely distributed command-line software utility TAR. All other files, including constituent files within the .tar.gz archives, can be opened in the open-source R statistical computing environment. Alternatively, .csv files may also be read in any simple text editor software or Microsoft Excel. Geospatial files including .shp and .tif files can also be opened in GIS software, such as QGIS (open-source) or ESRI ArcGIS (proprietary). The .pdf Data User Guide can be read with Adobe Acrobat Reader or other compatible readers.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2025

Stability-preserving Lossy Compression for Large-scale Partial Differential Equations

Checkpoint/Restart (C/R) strategies are vital for fault tolerance in PDE-based scientific simulations, yet traditional checkpointing incurs significant I/O overhead. Lossy compression offers a scalable solution by reducing checkpoint data size, but conventional methods often lack control over physical invariants (e.g., energy), leading to instability such as oscillations or divergence in Partial Differential Equations (PDE) systems. This paper introduces a stability-preserving compression approach tailored for PDE simulations by explicitly controlling kinetic and potential energy perturbations to ensure stable restarts. Extensive experiments conducted across diverse PDE configurations demonstrate that our method maintains numerical stability with minimal error magnification—even across multiple checkpoint-restart cycles—outperforming state-of-the-art lossy compressors. Parallel evaluations on the Frontier supercomputer show up to 8.4× improvement in checkpoint write performance and 6.3× in read performance, while maintaining relative L2 errors ∼ 2e-6 throughout continued simulation. These results provide practical guidance for balancing compression accuracy, stability, and computational efficiency in large-scale PDE applications.

Gong, Qian [ORNL] (ORCID:0000000235704142)↗
DOE OSTI2025

An analysis of parameter compression and Full-Modeling techniques with Velocileptors for DESI 2024 and beyond

In anticipation of forthcoming data releases of current and future spectroscopic surveys, we present the validation tests and analysis of systematic effects within velocileptors modeling pipeline when fitting mock data from the AbacusSummit N-body simulations. We compare the constraints obtained from parameter compression methods to the direct fitting (Full-Modeling) approaches of modeling the galaxy power spectra, and show that the ShapeFit extension to the traditional template method is consistent with the Full-Modeling method within the standard ΛCDM parameter space. We show the dependence on scale cuts when fitting the different redshift bins using the ShapeFit and Full-Modeling methods. We test the ability to jointly fit data from multiple redshift bins as well as joint analysis of the pre-reconstruction power spectrum with the post-reconstruction BAO correlation function signal. We further demonstrate the behavior of the model when opening up the parameter space beyond ΛCDM and also when combining likelihoods with external datasets, namely the Planck CMB priors. Finally, we describe different parametrization options for the galaxy bias, counterterm, and stochastic parameters, and employ the halo model in order to physically motivate suitable priors that are necessary to ensure the stability of the perturbation theory.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

Utah FORGE: Well Acord 1-26 Logs and Data: Roosevelt Hot Spring Area

This is a compilation of logs and data from Well Acord 1-26 in the Roosevelt Hot Springs area in Utah. This well is also in the Utah FORGE study area. Logs include: mud log (45'-12645'), compensated densilog (1102'-7923', 7900'-12644'), neutron log (1102'-7923'), dual induction focused logs (1100'-7923', 7904'-11447'), BHC acoustilog (7800'-11439'), differential temperature log (380'-11448'), gamma ray neutron logs (7900'-12148', 12000'-12647'), temperature logs (7900'-12144', 7900'-12145', 7800'-12655', 7900'-12655'), and caliper log (7800'-12655'), densilog (7900'-12655'). The file is in a compressed .zip format and there is a data inventory table (Excel spreadsheet) in the root folder that is a guide to the data that is accessible in subfolders.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

High-pressure structural systematics of dysprosium metal compressed in a neon pressure medium to 182 GPa

Here we present an experimental and theoretical study of dysprosium metal compressed in the soft pressure transmitting medium Ne up to 182 and 300 GPa, respectively. Angle-dispersive x-ray powder diffraction data from each of the high-pressure polymorphs shows anisotropic compression behavior indicating changes to the electron density distribution throughout its polymorphic landscape. We compare the monoclinic (mC4) and orthorhombic (oF16) structures for the collapsed structure for Dy above 82 GPa and verify that the oF16 structure offers a better fit to our data than the previously reported mC4 structure. Further, we have found that the oF16 structure undergoes similar anisotropic compression of its lattice parameters, with a turning point above 160 GPa; suggesting a potential phase transition at pressures much higher than achieved in this study. Density functional theory calculations show the likely candidate for this new high-pressure phase is the isosymmetric oF8 structure, which is predicted to be lower in energy than the oF16 structure above 275 GPa.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

An Incremental Tensor Train Decomposition Algorithm

We present a new algorithm for incrementally updating the tensor train decomposition of a stream of tensor data. This new algorithm, called the tensor train incremental core expansion (TT-ICE) improves upon the current state-of-the-art algorithms for compressing in tensor train format by developing a new adaptive approach that incurs significantly slower rank growth and guarantees compression accuracy. This capability is achieved by limiting the number of new vectors appended to the TT-cores of an existing accumulation tensor after each data increment. These vectors represent directions orthogonal to the span of existing cores and are limited to those needed to represent a newly arrived tensor to a target accuracy. We provide two versions of the algorithm: TT-ICE and TT-ICE accelerated with heuristics (TT-ICE*). Here, we provide a proof of correctness for TT-ICE and empirically demonstrate the performance of the algorithms in compressing large-scale video and scientific simulation datasets. Compared to existing approaches that also use rank adaptation, TT-ICE* achieves 57× higher compression and up to 95% reduction in computational time.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Land cover classification in multispectral imagery using clustering of sparse approximations over learned feature dictionaries

We present results from an ongoing effort to extend neuromimetic machine vision algorithms to multispectral data using adaptive signal processing combined with compressive sensing and machine learning techniques. Our goal is to develop a robust classification methodology that will allow for automated discretization of the landscape into distinct units based on attributes such as vegetation, surface hydrological properties, and topographic/geomorphic characteristics. We use a Hebbian learning rule to build spectral-textural dictionaries that are tailored for classification. We learn our dictionaries from millions of overlapping multispectral image patches and then use a pursuit search to generate classification features. Land cover labels are automatically generated using unsupervised clustering of sparse approximations (CoSA). We demonstrate our method on multispectral WorldView-2 data from a coastal plain ecosystem in Barrow, Alaska. We explore learning from both raw multispectral imagery and normalized band difference indices. We explore a quantitative metric to evaluate the spectral properties of the clusters in order to potentially aid in assigning land cover categories to the cluster labels. In this study, our results suggest CoSA is a promising approach to unsupervised land cover classification in high-resolution satellite imagery.

42 ENGINEERING↗
DOE OSTI2016

Inelastic response of silicon to shock compression

The elastic and inelastic response of [001] oriented silicon to laser compression has been a topic of considerable discussion for well over a decade, yet there has been little progress in understanding the basic behaviour of this apparently simple material. We present experimental x-ray diffraction data showing complex elastic strain profiles in laser compressed samples on nanosecond timescales. We also present molecular dynamics and elasticity code modelling which suggests that a pressure induced phase transition is the cause of the previously reported ‘anomalous’ elastic waves. Moreover, this interpretation allows for measurement of the kinetic timescales for transition. Lastly, this model is also discussed in the wider context of reported deformation of silicon to rapid compression in the literature.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Diagnostic signature of the compressibility of the inertial-confinement-fusion pusher

In this study, carbon shell areal density measurements from many types of inertial confinement fusion implosions at the National Ignition Facility (NIF) demonstrate that the final state of the outside portion of the shell is set primarily by capsule coast time, the coasting period between main laser shut off and peak fusion output. However, the fuel areal density does not correlate with the increasing carbon compression. While two-dimensional (2D) radiation-hydrodynamic simulations successfully capture the carbon compression, energy must be added to the simulated fuel-ice layer to reproduce fuel areal density measurements. The data presented demonstrates that the degradation mechanisms that reduce the compressibility of the fuel do not reduce the compressibility of the ablator.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Robustness of deep learning algorithms in astronomy -- galaxy morphology studies

Deep learning models are being increasingly adopted in wide array of scientific domains, especially to handle high-dimensionality and volume of the scientific data. However, these models tend to be brittle due to their complexity and overparametrization, especially to the inadvertent adversarial perturbations that can appear due to common image processing such as compression or blurring that are often seen with real scientific data. It is crucial to understand this brittleness and develop models robust to these adversarial perturbations. To this end, we study the effect of observational noise from the exposure time, as well as the worst case scenario of a one-pixel attack as a proxy for compression or telescope errors on performance of ResNet18 trained to distinguish between galaxies of different morphologies in LSST mock data. We also explore how domain adaptation techniques can help improve model robustness in case of this type of naturally occurring attacks and help scientists build more trustworthy and stable models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Developing a Drilling Optimization System for Improved Overall Rate of Penetration in Geothermal Wells

Geothermal energy is renewable, reliable and environmentally friendly source of energy. The major cost in the development of geothermal wells is the actual drilling of the wells. The main objective of this paper is to introduce a new real-time drilling optimization system designed for granite formation to reduce the overall drilling cost. In this study, a drilling optimization system is verified using drilling data from Utah-Forge well 58-32. The drilling optimization system used the Utah-Forge well 58-32 data to achieve real-time unconfined compressive strength (UCS). Based on the UCS value from the previous feet, the system simulates the ROP for the next drilling feet. The drilling optimization system utilizes the Differential Evolution Algorithm (DEA), which is a metaheuristic method to search the space of solution, to find the best operating parameters (i.e. WOB and RPM) for the next drilling foot. The optimization algorithm takes a maximum cutter temperature into account as a constraint and avoids the accelerated wear. The developed drilling optimization system improves ROP responses and reduces the drilling cost of geothermal wells. The simulated ROP results from the system show a good agreement with the ROP from Utah-Forge well 58-32 drilling data. The drilling time before and after optimization for both intervals were presented.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Milestone report for MRT 8504: Commission EXAFS spectrometer with spectral range of 17.95-18.6 keV design to obtain EXAFS data for Pu L shell experiments

This milestone describes the development and fielding of EXAFS Phase II spectrometer designed to provide high quality (SNR>=5) EXAFS spectra for Plutonium measurements at the National Ignition facility (NIF). Benefits: the EXAFS data will be used by the High Energy Density (HED) Physics and more specifically the Focused Material Science program to measure the thermal state of compressed materials with good temperature sensitivity (~100-1000 Kelvin). Data with good signal to noise ratio (SNR>=5) and good spectral resolution allows the FMS program to fill a gap in diagnosing temperature to completely constrain material properties for weapon physics and Stockpile Stewardship applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Accurate Ultrasonic Thickness Measurement for Arbitrary Time-Variant Thermal Profile

Ultrasonic thickness measurement of mechanical structures is one of the most popular and commonly used nondestructive methods for various kinds of process control and corrosion monitoring. With ultrasonic propagation speed being temperature-dependent, the thickness measurement can be performed reliably only when the thermal profile is completely known. Most conventional techniques assume the temperature of the test structure is uniform and at room temperature across its thickness. Such assumptions may lead to large errors in the thickness measurement, especially when there are significant temperature variations across the thickness. State-of-the-art techniques use external temperature measurements or implement iterative methods to compensate for the unknown thermal profiles. However, such techniques produce unsatisfactory results when the heat distribution is complex or varies rapidly with time. In this work, we propose a two-sensors technique, using both compressive and shear excitations, with a non-iterative rapid data processing method for accurate thickness measurement under arbitrary time-variant thermal profile. The independent behavior of shear and compressive waves is used to formulate a real-time thickness estimation technique. The developed technique is experimentally validated on a steel plate with fixed acoustic sensors. Test results show that the error in thickness estimation can be reduced by up to 98% compared to conventional thickness gauging methods.

36 MATERIALS SCIENCE↗
DOE OSTI2014

TH-E-17A-09: High Quality and Artifact-Free 4D Cone Beam CT and Its Application in Adaptive Treatment Planning

Purpose: To develop a high quality 4D cone beam CT (4DCBCT) method that is immune to patient/couch truncations and to investigate its application in adaptive replanning of lung XRT. Methods: In this study, IRB-approved human subject CBCT data was acquired using a Varian on-board imager with 1 minute rotation time. The acquired projection data was retrospectively sorted into 20 respiratory phase bins, from which 4DCBCT images with high SNR and high temporal resolution were generated using Prior Image Constrained Compressed Sensing (PICCS). Couch and patient truncations generate strong data inconsistency in the projection data and artifacts in the 4DCBCT image. They were addressed using an adaptive PICCS method. The artifact-free PICCS-4DCBCT images were used to generate adaptive treatment plans for the same patient at the 10th (day 21) and 30th (day 47) fractions. Dosimetric impacts with and without PICCS- 4DCBCT were evaluated by isodose distributions, DVHs, and other dosimetric factors. Results: The adaptive PICCS-4DCBCT method improves image quality by removing residue truncation artifacts; measured universal image quality increased 37%. The isodose lines and DVHs with PICCS-4DCBCT-based adaptive replanning were significantly more conformal to PTV than without replanning due to changes in patient anatomy caused by progress of the treatment. The mean dose to PTV at the 10th fraction was 63.1Gy with replanning and 64.2Gy without replanning, where the prescribed dose was 60Gy, in 2Gy × 30 fractions. The mean dose to PTV at the 30th fraction was 61.6Gy with replanning and 64.9Gy without replanning. Lung V20 was 37.1%, 41.9% and 43.3% for original plan, 10th fraction plan and 30th fraction plan; with re-planning, Lung V20 was 37.1%, 32%, 27.8%. Conclusion: 4DCBCT imaging using adaptive PICCS is able to generate high quality, artifact-free images that potentially can be used to create replanning for improving radiotherapy of the lung. K Niu, K Li, J Smilowitz: Nothing to Disclose. G Chen: General Electric Company Research funded, Siemens AG Research funded, Varian Medical Systems Research funded, Hologic Research funded.

60 APPLIED LIFE SCIENCES↗