Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84
All sourcesNASA NTRSDOE OSTI
NASA NTRS1975

The problem of the man-space data interface during computer processing of data

The necessity is shown for data output at different processing stages to man, taking into account the processing level, the output objective, and the user. The use of the phototelegraph I/O computer device for this purpose is considered in detail, and several examples are given. It is shown that the type of output (shaded of halftone graphs), the scales, the compression, and the mutual position of the data are selected on the basis of the character of the data displayed.

Mamotko, Z. N.↗
NASA NTRS1974

Application of an invariant second-order closure model to compressible turbulent shear layers

A second-order closure model for two-dimensional, compressible shear flows is investigated using the invariant modeling technique developed by Donaldson. The invariant model parameters were originally selected by comparison of model predictions with critical experimental data on basic incompressible flows. Additional modeling for compressible flows has been introduced. A number of different shear flows such as the free shear layer, flat plate boundary layer and a simulation of the mixing region of a chemical laser are computed. The model is consistent with first-order closure turbulence models for equilibrium flows and is further capable of predicting nonequilibrium flows that cannot be correctly solved by eddy viscosity models. The results are in generally good agreement with experimental measurements but suggest the need for inclusion of a Mach number dependent model of the pressure diffusion terms in order to adequately represent high speed compressible flows.

Varma, A. K.↗
DOE OSTI2025

TRAILS Output Files

Overview This data repository contains ZIP files that store compressed versions of the output of running the WaterPaths utility planning and management tool in the DU Re-Evaluation mode (to download the tool, please see this GitHub repository). The tool was used to simulate the six-utility North Carolina Research Triangle problem. Details on the contents of each ZIP file can be seen below. Data details Temporal range: Weekly data for 2,344 weeks from 2015 to 2060 (45 years). Spatial range: Six water utilities in the North Carolina Research Triangle region (0: Chapel Hil/OWASA, 1: Durham, 2: Cary, 3: Raleigh, 4: Pittsboro, and 5: Chatham) File types: CSV and OUT Different solutions available The solution numbers correspond to the different pathway strategies (henceforth referred to as "solutions") discussed in paper's main and supporting text (abstract and link to the paper here). They are as follows: Sol92: The Durham-focused pathway strategy Sol132: The Raleigh-focused pathway strategy Sol140: The regionally-robust pathway strategy Objectives files These files can be accessed by unzipping solXX_objectives_pathways.zip that contains 1,000 Objectives_RDMXX_solsXX_to_XX.csv files. Each CSV file will consist of a row representing all the objective values for that specific solution, while every six columns represents the reliability, restriction frequency, infrastructure net present value ($ mil), peak financial cost, worst-case cost, and unit cost ($ per MG; in that order) for each of the six utilities. There will be 1,000 such files, denoting the performance of the six utilities across the 1,000 deeply uncertain states of the world (DU SOWs). Pathway files These files can be accessed by unzipping solXX_objectives_pathways.zip that contains 1,000 Pathways_sXX_RDMXX.out file. Each OUT corresponds to the set of infrastructure being triggered in a specific DU SOW, and each file will have the name file will consist of four tab-delimited columns that are described as follows: Realization: The realization in which an infrastructure options being triggered utility: The utility currently triggering infrastructure week: The week in which a specific infrastructure option is being triggered infra.: The infrastructure option being triggered If the OUT file contains only the header line, no infrastructure was triggered for that specific DU SOW. Policies files These files can be obtained by unzipping Policies.zip. Each of the 1,000 CSV files within the unzipped folder will contain weekly water use restriction policies for all 1,000 hydroclimatic realizations within a specific DU SOW. The column structure is as follows: 0rest_m: restriction multiplier for utility 0 (values between 0 and 1) 1rest_m: restriction multiplier for utility 1 (values between 0 and 1) 2rest_m: restriction multiplier for utility 2 (values between 0 and 1) 3rest_m: restriction multiplier for utility 3 (values between 0 and 1) 4rest_m: restriction multiplier for utility 4 (values between 0 and 1) 5rest_m: restriction multiplier for utility 5 (values between 0 and 1) 0transf: transfer volume for utility 0 (in MGD) 1transf: transfer volume for utility 1 (in MGD) 2transf: transfer volume for utility 2 (in MGD) 3transf: transfer volume for utility 3 (in MGD) 4transf: transfer volume for utility 4 (in MGD) 5transf: transfer volume for utility 5 (in MGD) Water Sources files These files can be obtained by unzipping WaterSources_subset.zip. Each of the 100 CSV files within the unzipped folder will contain weekly state variables at each water source for all 1,000 hydroclimatic realizations within a specific DU SOW. The column structure is as follows: Xvolume: available water volume from source X (in MGD) Xs_area: surface area of source X (in ACF) Xdemand: demand drawn from a water source from source X (in MGD) Xup_spill: upstream spillage from source X (in MGD) Xww_inflow: wastewater inflow from source X (in MGD) Xcatch_inflow: upstream catchment inflow to source X (in MGD) Xevap: evaporation multiplier for source X (values between 0 and 1) Xds_spill: downstream spillage from source X (in MGD) X_Y_alloc_cap: the allocated capacity from source X to utility Y (values between 0 and 1) X_Y_alloc_dem: the allocated demand from source X to utility Y (values between 0 and 1) Xtrmt_alloc_Y: the allocated treatment capacity from source X to utility Y (values between 0 and 1) Utilities files These files can be obtained by unzipping Utilities_subset.zip. Each of the 100 CSV files within the unzipped folder will contain weekly state variables at each utility for all 1,000 hydroclimatic realizations within a specific DU SOW. The column structure is as follows: Xst_vol: total available storage volume of utility X (in MG) Xcapacity: total storage capacity of utility X (in MG) Xnet_inf: : net inflow for all storage infrastructure for utility X (in MGD) Xst_rof: short term ROF for utility X (values between 0 and 1) Xst_stor_rof: short-term storage ROF for utility X (values between 0 and 1) Xst_trmt_rof: short-term treatment ROF for utility X (values between 0 and 1) Xlt_rof: long-term ROF for utility X (values between 0 and 1) Xlt_stor_rof: long-term storage ROF for utility X (values between 0 and 1) Xlt_trmt_rof: long-term treatment ROF for utility X (values between 0 and 1) Xrest_demand: restricted demand for utility X (in MGD) Xunrest_demand: unrestricted demand for utility X (in MGD) Xunfulf_demand: unfulfilled demand for utility X (in MGD) Xwastewater: wastewater return for utility X (in MGD) Xtreat_capacity: total treatment capacity for utility X (in MG) Xcont_fund: reserve (contingency) fund balance for utility X Xins_pout: insurance payout for utility X (% annual volumetric revenue) Xins_price: insurance price for utility X (% annual volumetric revenue) Xinfra_npv: infrastructure net present value for utility ($mil) Xst_vol: total available storage volume of utility X (in MG) Xdebt_serv: debt service for utility X (usually once per year if the infrastructure is triggered; % annual volumetric revenue) Xstor_vol: total stored volume (in MGD) Xobs_ann_dem: observed annual demand for utility X (in MGD) Xproj_dem: projected annual demand for utility X (in MGD) Xpv_debt_serv: present value of debt service payments for utility X (% annual volumetric revenue) Xgross_rev: gross revenue for utility X ($mil) Acknowledgment IM3 is a multi-institutional effort led by Pacific Northwest National Laboratory and supported by the U.S. Department of Energy's Office of Science as part of research in MultiSector Dynamics, Earth and Environmental Systems Modeling Program.

Artificial Intelligence↗
NASA NTRS1991

Modeling the rapid spherical compression of isotropic turbulence

Rapid distortion analysis is used to modify the form of the closure model for the dissipation rate of the turbulent kinetic energy. The modification is such that the evolution of the dissipation rate during a rapid compression is predicted exactly; good agreement between the model prediction and direct simulation data is obtained. Previous closure proposals fail to properly predict the rapid compression case. The reason for the difference between the present and previous models is traced to the fact that previous workers neglected variations of kinematic viscosity.

Coleman, Gary N.↗
DOE OSTI2024

guppy i : a code for reducing the storage requirements of cosmological simulations

ABSTRACT As cosmological simulations have grown in size, the permanent storage requirements of their particle data have also grown. Even modest simulations present a major logistical challenge for the groups which run these boxes and researchers without access to high performance computing facilities often need to restrict their analysis to lower quality data. In this paper, we present guppy, a compression algorithm and code base tailored to reduce the sizes of dark matter-only cosmological simulations by approximately an order of magnitude. guppy is a ‘lossy’ algorithm, meaning that it injects a small amount of controlled and uncorrelated noise into particle properties. We perform extensive tests on the impact that this noise has on the internal structure of dark matter haloes, and identify conservative accuracy limits which ensure that compression has no practical impact on single-snapshot halo properties, profiles, and abundances. We also release functional prototype libraries in C, Python, and Go for reading and creating guppy data.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRSDate not supplied

Using Holey Graphene for Improved Interfacial Contact in Solid Electrolyte Ionic Conductivity Measurements

Solid-state batteries (SSBs) are poised to become the batteries of the future with advantages such as higher energy density, lighter weight, versatile geometry, and greater safety due to low flammability risk. An important parameter of the solid electrolyte (SE) used is its ionic conductivity. The ionic conductivity is generally calculated from the bulk resistance of a SE pellet, measured from the electrochemical impedance spectroscopy data. The SE pellet is typically prepared from the electrolyte powder by dry compression and is sandwiched between two blocking current collectors to obtain the impedance spectroscopy data. One of the challenges in conducting this measurement is poor interfacial contacts between the SE pellet and the current collector surfaces. Therefore, measurements reported in the literature may underestimate the true ionic conductivity of a given electrolyte. Holey graphene is a carbon nanomaterial with high electrical conductivity and unique dry compressibility, which is unusual for carbon materials but similar to many oxide and sulfide SEs. In this work, it is demonstrated that adding a thin layer of holey graphene between the electrolyte and the stainless steel current collectors significantly improves the interfacial contact. The ionic conductivity values obtained in the effort were sometimes several times higher than the data measured for SEs without the holey graphene layers. This work calls for more standardized measurement procedures to reduce the discrepancies in reported ionic conductivity values.

Solid state battery↗
DOE OSTI2020

Automated identification of deformation twin systems in Mg WE43 from SEM DIC

In this study, the application of machine learning and computer vision approaches to microscale deformation data for the automated identification of deformation twinning systems, and their associated twin area, is introduced. Deformation data was obtained during in-situ SEM compression testing of a WE43 Mg alloy using digital image correlation (DIC) modified for use with electron microscopy. A 5.7 mm × 3.4 mm area of interest was analyzed, generating ~100 million data points of deformation. Experimental twin trace directions were determined by applying k-means clustering, morphological thinning, and Hough transforms to the deformation data. The identification of deformation twinning was achieved by consideration of the twin trace direction, its strain value, and its evolution. The deformation map was divided into areas corresponding to individual active twin systems, enabling the analysis of microstructure dependence of deformation behavior and twinning activity. The performance of the proposed twinning identification approach was evaluated by accuracy, precision, and sensitivity metrics. The effect of the tuning parameters used in the algorithm on the performance is also discussed.

36 MATERIALS SCIENCE↗
NASA NTRS1924

Increasing the compression pressure in an engine by using a long intake pipe

During some tests of a one-cylinder engine, using gas oil (diesel engine oil, specific gravity 0.86 at 60 F) with solid injection and compression ignition, it was found to be necessary to increase either the jacket water temperature or the compression pressure in order to start the engine. It was found that a sufficient increase in compression pressure could be obtained simply by attaching a long pipe to the inlet flange of the cylinder. However, since no data were available giving the values of the increase in compression pressure that might be expected from such a step-up, an investigation was made covering some engine speeds between 500 r.p.m. and 1800 r.p.m. The data obtained are included here in the form of curves. Although this data is not strictly applicable to another engine, it should give indications of what might be expected with such a set-up on an engine operating at similar speeds. The engine used was a single cylinder Liberty, 5-inch bore and 7-inch stroke, having standard cylinder, cams, valves, and valve timing and operating on a four-stroke cycle.

Mathews, Robertson↗
NASA NTRSDate not supplied

Thermal Effects of Pressure Surge and Adiabatic Compression in the Priming of Propulsion and Propellant Transfer Systems

Surge pressures and adiabatic compression during priming of evacuated lines in propulsion and propellant transfer systems has been considered. Test data were obtained for desaturated and saturated water for surge pressures and adiabatic compression for various supply pressures and temperatures. Scaling of surge pressures a t different temperatures has been carried out with the aid of Joukowsky model. The thermal effects associated with surge pressure and the attendant adiabatic compression have been investigated with the a id of a simplified analytical model, which represents an extension of the model developed by Lecourt and Steelant. It has been shown that the predictions from the model compare satisfactorily with test data for a water/helium system, and existing test data for different liquid/gas combinations.

Pressure Surge↗
NASA NTRS2023

Elastic Modulus Testing for TriTruss Struts

The TriTruss is a novel structural module developed by researchers at NASA Langley Research Center (LaRC) that can be used in space to assemble large backing structures for a variety of applications. One such application is the metering truss and primary mirror backbone support structure of an in-space assembled telescope(iSAT). For the iSAT application, the TriTruss will be supporting mirror segments, payloads, and instruments, all of which require the TriTruss to have robust structural integrity. An accurate elastic modulus value is crucial to the finite element analysis(FEA) of the structure. Initial testing indicated that the equivalent elastic modulus provided by the manufacturer and used in the analyses did not accurately predict the behavior of the structure. In this paper, the in-house testing method developed at LaRC to accurately measure the equivalent elastic modulus of the composite struts for use in the analyses is described. A tensile and compressive equivalent elastic modulus was computed from the data obtained in this test. The testing resulted in a tensile equivalent elastic modulus of 24.6 Msi (standard deviation of 0.888 Msi) or 169 GPa (standard deviation of 6.20 GPa) and a compressive equivalent elastic modulus of 22.8 Msi (standard deviation of 0.780 Msi) or 157 GPa(standard deviation of 5.38 GPa) for the single wall thickness struts. For double wall thickness struts, the testing resulted in a tensile equivalent elastic modulus of32.1 Msi (standard deviation of 1.003 Msi) or 221 GPa (standard deviation of 6.91GPa) and a compressive equivalent elastic modulus of 31.9 Msi (standard deviation of 1.123) or 220 GPa (standard deviation of 7.74 GPa).1

TriTruss↗
DOE OSTI2024

Time-resolved X-ray diffraction diagnostic development for the National Ignition Facility

Here we present the development of an experimental platform that can collect four frames of x-ray diffraction data along a single line of sight during laser-driven, dynamic-compression experiments at the National Ignition Facility. The platform is comprised of a diagnostic imager built around ultrafast sensors with a 2-ns integration time, a custom target assembly that serves also to shield the imager, and a 10-ns duration, quasi-monochromatic x-ray source produced by laser-generated plasma. We demonstrate the performance with diffraction data for Pb ramp compressed to 150 GPa and illuminated by a Ge x-ray source that produces ∼7 × 10 11 , 10.25-keV photons/ns at the 400 μm diameter sample.

36 MATERIALS SCIENCE↗
DOE OSTI2021

The Cost of Decarbonization and Energy Upgrade Retrofits for US Homes

Cost is a major barrier when upgrading homes to reduce carbon emissions required to meet DOE’s climate-related goals. This report summarizes a nationwide effort to gather home energy upgrade project cost data along with household energy performance data. The goal was to develop cost benchmarks and to guide future R&D efforts aimed at cost compression and scaling of the residential upgrade market. The cost data were compiled for both total project costs and costs of individual measures. The majority of energy savings were modeled, with some models using measured site data for calibration. The database was analyzed using clustering techniques to find common energy and CO2 reduction approaches. The individual measures were combined into archetypal solutions to determine least-cost approaches to maximizing energy and carbon savings. Several financial analyses were preformed to examine other cost metrics beyond first cost. Project data was obtained for 1,739 projects, from 15 states and 12 energy programs, with a total of 10,512 individual measures. The database includes a wide-array of projects, ranging from single-measure HVAC upgrades to net-zero energy whole home remodels. Projects were predominantly single-family detached dwellings with wood frame construction. Most of the data was obtained from energy programs because they had recorded the necessary information and were willing to share with this study. This sample of convenience can provide broad guidance and national cost benchmarks, but lacks sufficient detail to draw more disaggregated conclusions, such as geographical trends. The majority of data contributions were obtained without compensation from sources where the required data was already in some sort of structured format. We compensated sources to enter data from individual projects into a structured data format for about 500 projects, with an average cost of about $40 per project. The database was highly skewed to lower cost, lower impact projects due to the nature of the sample of convenience. Less than 10% of projects had savings greater than 50%. The cost data for individual measures in the database are being used in other DOE efforts on residential energy use/decarbonization. This data collection effort should continue in order to provide the best-informed guidance for DOE and industry R&D, as well as deployment efforts (including policy and program planning).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1971

Facsimile bandwidth compression using nonlinear analog processing.

A system is presented for reducing the number of picture elements in a scanned image by an order of magnitude while preserving the detail contrast. Starting with high-resolution data a 3 x 3 matrix of input elements is compressed into a single output element using a nonlinear algorithm. Optimum results are obtained by including the data on the outer periphery of the input sample in the processing algorithm thus requiring a 5 x 5 input matrix. Experimental results are presented using weather satellite photographs. This system has application in those cases where the sensor has higher resolution capability than the communication link can support.

Macovski, A.↗
NASA NTRS2022

Cross-Cutting Flight Infrastructure Improvements on M2020

Mars2020 (M2020) was formulated as a mission that leveraged as much Mars Science Laboratory (MSL) heritage as possible, while focusing major new development efforts on the original and unique elements needed to accomplish the different mission objectives. Well publicized examples of high profile new developments include precision landing, the sampling and caching system, the specific instrument suite, improved mobility via Autonomous Navigation, and later the addition of the Ingenuity helicopter. Less well known are the refinements to the core flight infrastructure, primarily in the cross-cutting functions of Telecom, Avionics, Data Management, Communications Behaviors, and Parameter Management. These enhancements are introduced predominately via flight software, and represent increases in capability that justified their inclusion in an otherwise heritage-focused project environment.Perseverance’s cross-cutting flight infrastructure improvements fall into and across the following five categories. First is a trimming of the software footprint of infrastructure modules, in order to make room for memory demands elsewhere in the system. Second is the minimization of data volume to be downlinked, through various methods such as the incorporation of new compression options. Third is the maximization of the available downlink bandwidth for data, by curtailing content-less data (fill) and introducing an improved UHF proximity link protocol. Fourth is a reduction in vulnerabilities, through increased file system redundancy, robustness, and software process monitoring. Fifth is an increase in operations efficiency by lowering file system mount times, improving parallelism between simultaneous events, minimizing the time to recover from file system errors, streamlining the purging of obsolete data, and reducing the number of commands to service parameters by a factor of 100.Individually, none of the cross-cutting infrastructure improvements are likely to garner headlines, but collectively they appreciably improve the safety and operability of Perseverance over its predecessor. This paper will describe the improvements, their promise, and where applicable, their actual impact in operations.

Bohannon, Emily↗
DOE OSTI2025

Data from: 'Abiotic influences on continuous conifer forest structure across a subalpine watershed'

This package archives the core data used for analysis and inference in 'Abiotic influences on continuous conifer forest structure across a subalpine watershed' (Worsham et al., 2025). All data were collected in the East River, Washington Gulch, Slate River, and Coal Creek watersheds of Colorado. In the paper, we quantified the relative influence of climate, topographic, edaphic, and geologic factors on conifer stand structure and composition, and their functional relationships, at the watershed scale. We used waveform LiDAR data to derive spatially continuous stand structure metrics. We fused these with a species-level classification map to estimate tree species abundance. We applied generalized additive and generalized boosted models to evaluate the covariability of structural and compositional metrics with abiotic variables. The package contains the essential products required for reproducing our analysis and the tables and figures reported in the publication. The products comprise four classes: (1) geospatial data, (2) tabular data used for inferential analysis, (3) tabular data describing analytical results and performance statistics, and (4) a data user guide. (1) includes discretized waveform LiDAR data, locations and attributes of individual tree crowns, sampling locations and domain boundaries, a canopy height model, and raster files of estimated forest structural and compositional metrics at 100 m grid scale. (2) includes all response and explanatory variable values applied in inferential models. Response variables include conifer forest stand density, basal area, 95th percentile height, quadratic mean diameter, and others. Explanatory variables include climatic water deficit, actual evapotranspiration, elevation, heat load, soil available water content, and others. (3) includes results of training and testing several individual tree detection (ITD) algorithms, as well as inferential modeling results. (4) is a PDF user guide for this data package, including detailed descriptions and data dictionaries for all files. The data package root contains 17 assets: 8 compressed tape archive (.tar.gz) files, 5 comma-separated values (.csv) files, 3 Geographic Tagged Image File Format (GeoTIFF) (.tif) files, and 1 Portable Document Format (.pdf) file. The compressed .tar.gz archives contain ESRI shapefiles (.shp) .tif, compressed LASer (.laz), and .csv files. The archives must first be decompressed using the widely distributed command-line software utility TAR. All other files, including constituent files within the .tar.gz archives, can be opened in the open-source R statistical computing environment. Alternatively, .csv files may also be read in any simple text editor software or Microsoft Excel. Geospatial files including .shp and .tif files can also be opened in GIS software, such as QGIS (open-source) or ESRI ArcGIS (proprietary). The .pdf Data User Guide can be read with Adobe Acrobat Reader or other compatible readers.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2025

Stability-preserving Lossy Compression for Large-scale Partial Differential Equations

Checkpoint/Restart (C/R) strategies are vital for fault tolerance in PDE-based scientific simulations, yet traditional checkpointing incurs significant I/O overhead. Lossy compression offers a scalable solution by reducing checkpoint data size, but conventional methods often lack control over physical invariants (e.g., energy), leading to instability such as oscillations or divergence in Partial Differential Equations (PDE) systems. This paper introduces a stability-preserving compression approach tailored for PDE simulations by explicitly controlling kinetic and potential energy perturbations to ensure stable restarts. Extensive experiments conducted across diverse PDE configurations demonstrate that our method maintains numerical stability with minimal error magnification—even across multiple checkpoint-restart cycles—outperforming state-of-the-art lossy compressors. Parallel evaluations on the Frontier supercomputer show up to 8.4× improvement in checkpoint write performance and 6.3× in read performance, while maintaining relative L2 errors ∼ 2e-6 throughout continued simulation. These results provide practical guidance for balancing compression accuracy, stability, and computational efficiency in large-scale PDE applications.

Gong, Qian [ORNL] (ORCID:0000000235704142)↗
DOE OSTI2025

An analysis of parameter compression and Full-Modeling techniques with Velocileptors for DESI 2024 and beyond

In anticipation of forthcoming data releases of current and future spectroscopic surveys, we present the validation tests and analysis of systematic effects within velocileptors modeling pipeline when fitting mock data from the AbacusSummit N-body simulations. We compare the constraints obtained from parameter compression methods to the direct fitting (Full-Modeling) approaches of modeling the galaxy power spectra, and show that the ShapeFit extension to the traditional template method is consistent with the Full-Modeling method within the standard ΛCDM parameter space. We show the dependence on scale cuts when fitting the different redshift bins using the ShapeFit and Full-Modeling methods. We test the ability to jointly fit data from multiple redshift bins as well as joint analysis of the pre-reconstruction power spectrum with the post-reconstruction BAO correlation function signal. We further demonstrate the behavior of the model when opening up the parameter space beyond ΛCDM and also when combining likelihoods with external datasets, namely the Planck CMB priors. Finally, we describe different parametrization options for the galaxy bias, counterterm, and stochastic parameters, and employ the halo model in order to physically motivate suitable priors that are necessary to ensure the stability of the perturbation theory.

79 ASTRONOMY AND ASTROPHYSICS↗