Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “in situ data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Approximation of ice phenology of Maine lakes using Aqua MODIS surface temperature data

Studies of lake ice phenology have historically relied on limited in situ data. Relatively few observations exist for ice out and fewer still for ice in, both of which are necessary to determine the temporal extent of ice cover. Satellite data provide an opportunity to better document patterns of ice phenology across landscapes and relate them to the climatological drivers behind changing ice phenology. We developed a model, the Cumulative Sum Method (CSM), that uses daytime and nighttime surface temperature observations from the Moderate Resolution Imaging Spectroradiometer (MODIS) sensor on board the Earth-observing Aqua satellite to approximate ice in (the onset of ice cover) and ice out from training datasets of 13 and 58 Maine lakes, respectively, during the 2002/2003 through 2017/2018 ice seasons. Ice in was signaled by reaching a threshold of cumulative negative degrees following the first day of the season below 0°C. Ice out was signaled by reaching a threshold of cumulative positive degrees following the first day of the year above 0°C. The comparison of observed and remotely sensed ice-in dates showed relative agreement with a correlation coefficient of 0.71 and a mean absolute error (MAE) of 9.8 days. Ice-out approximations had a correlation coefficient of 0.67 and an MAE of 8.8 days. Lakes smaller in surface area and nearer the Atlantic coast had the greatest error in approximation. Application of the CSM to 20 additional lakes in Maine produced a comparable ice-out MAE of 8.9 days. Ice-out model performance was weaker for the warmest years; there was a larger MAE of 12.0 days when the model was applied to the years 2019–2023 for the original 58 lakes. The development of this model, which utilizes daily satellite data, demonstrates the promise of remote sensing for quantifying ice phenology over short, temporal scales, and wider geographic regions than can be observed in situ, and allows exploration of the influence of surface temperature patterns on the process and timing of ice in and ice out.

54 ENVIRONMENTAL SCIENCES↗

Integrating Maximum Entropy Production Theory and Machine Learning to Improve Global Evapotranspiration Modeling

Accurate estimation of terrestrial evapotranspiration (ET) is vital for understanding global water and energy cycles. However, current global ET estimations are not well constrained. This study introduces an integrated framework combining the Maximum Entropy Production (MEP) theory with Random Forest (RF) model to improve global ET estimation. Specifically, in contrast to direct ET estimation by the RF model, the integrated framework (MEP‐RF) trains to predict error of MEP‐simulated ET. MEP‐RF outperforms RF in spatiotemporal extrapolation. Attribution analysis with in situ observations reveals that the inputs of MEP are the most critical variables for the ET process, including net radiation, vegetated area, soil moisture, and surface temperature. We further drive MEP‐RF with global reanalysis and satellite data sets of these four inputs, yielding a global mean terrestrial ET of 548 mm/year, with 77% attributed to transpiration. The global ET increased at a rate of 0.85 mm/year per year during 2003–2021, primarily due to vegetation greening rather than rising temperature, while decreasing soil moisture led to decreasing regional ET. The integrated framework provides a novel approach for the estimation of global ET without the need for hard‐to‐obtain and thus uncertain inputs, such as wind speed, surface roughness, aerodynamic and canopy stomatal resistance. Therefore, MEP‐RF offers an independent method on existing global ET products. It represents a promising physically based approach that can be incorporated into Earth System Models to enhance water and energy cycle simulations.

54 ENVIRONMENTAL SCIENCES↗

Fierro Version 2.x

FIERRO is a parallel C++ code designed to simulate fluid mechanics, heat transfer, and solid mechanics in two- and three-dimensional space. FIERRO is written to run on homogeneous (CPU) and heterogeneous (CPU+GPU) high performance computing machines. Fierro can aid a) modeling and design efforts that have historically relied on commercial implicit and explicit finite element codes, b) numerical methods research, c) manufacturing research, and d) computer science research. The code contains diverse numerical methods to solve the governing physics equations for both quasi-static and dynamic problems. Mathematical optimization solvers are coupled to the numerical methods to research topology and shape optimization that has application to additive manufacturing, and to create novel numerical approaches. Phase-field methods with micromechanical solvers are provided to simulate microstructure formation and evolution in manufacturing processes. The micromechanical solvers can also help research efforts create continuum-scale constitutive models for solids, as a function of the microstructure, in situ in a calculation or in a stand-alone manner. No physical data exists within the code.

Morgan, Nathaniel↗

Fierro

FIERRO is a parallel C++ code designed to simulate fluid mechanics, heat transfer, and solid mechanics in two- and three dimensional space. FIERRO is written to run on homogeneous (CPU) and heterogeneous (CPU+GPU) high performance computing machines. Fierro can aid a) modeling and design efforts that have historically relied on commercial implicit and explicit finite element codes, b) numerical methods research, c) manufacturing research, and d) computer science research. The code contains diverse numerical methods to solve the governing physics equations for both quasi-static and dynamic problems. Mathematical optimization solvers are coupled to the numerical methods to research topology and shape optimization that has application to additive manufacturing, and to create novel numerical approaches. Phase-field methods with micromechanical solvers are provided to simulate microstructure formation and evolution in manufacturing processes. The micromechanical solvers can also help research efforts create continuum-scale constitutive models for solids, as a function of the microstructure, in situ in a calculation or in a stand-alone manner. No physical data exists within the code.

Morgan, Nathaniel↗

An Integrated Deposition and Passivation Strategy for Controlled Crystallization of 2D/3D Halide Perovskite Films

Abstract This work introduces a simplified deposition procedure for multidimensional (2D/3D) perovskite thin films, integrating a phenethylammonium chloride (PEACl)‐treatment into the antisolvent step when forming the 3D perovskite. This simultaneous deposition and passivation strategy reduces the number of synthesis steps while simultaneously stabilizing the halide perovskite film and improving the photovoltaic performance of resulting solar cell devices to 20.8%. Using a combination of multimodal in situ and additional ex situ characterizations, it is demonstrated that the introduction of PEACl during the perovskite film formation slows down the crystal growth process, which leads to a larger average grain size and narrower grain size distribution, thus reducing carrier recombination at grain boundaries and improving the device's performance and stability. The data suggests that during annealing of the wet film, the PEACl diffuses to the surface of the film, forming hydrophobic (quasi‐)2D structures that protect the bulk of the perovskite film from humidity‐induced degradation.

2D/3D perovskites↗

Evolution of standardization and dissemination of cryo-EM structures and data jointly by the community, PDB, and EMDB

Cryogenic electron microscopy (cryo-EM) methods began to be used in the mid-1970s to study thin and periodic arrays of proteins. Following a half-century of development in cryo-specimen preparation, instrumentation, data collection, data processing and modeling software, cryo-EM has become a routine method for solving structures from large biological assemblies to small biomolecules at near to true atomic resolution. This review explores the critical roles played by the Protein Data Bank (PDB) and Electron Microscopy Data Bank (EMDB) in partnership with the community to develop the necessary infrastructure to archive cryo-EM maps and associated models. Public access to cryo-EM structure data has in turn facilitated better understanding of structure-function relationships and advancement of image processing and modeling tool development. The partnership between the global cryo-EM community and PDB and EMDB leadership has synergistically shaped the standards for metadata, one-stop deposition of maps and models, and validation metrics to assess the quality of cryo-EM structures. The advent of cryo-electron tomography (cryo-ET) for in situ molecular cell structures at a broad resolution range and their correlations with other imaging data introduces new data archival challenges in terms of data size and complexity in the years to come.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

In-situ qualification and physics-based process design for aerosol jet printing via spatially correlated light scattering measurements

Aerosol jet printing is a contactless, digital, and additive technique broadly used for manufacturing flexible, hybrid, and conformal electronics. However, batch-to-batch variability has hindered widespread industry adoption and scaling to production volumes. Recently, light scattering measurements have emerged as a tool to measure aerosol volume fraction – a key parameter determining deposition rate – and have proven an effective feedback source for closed loop control on timescales ranging from minutes to hours. Here, the efficacy of light scattering measurements as a tool for in-situ qualification over shorter time durations is explored. To be the linear relationship between light scattering measurements and deposition rate was validated at 500 ms time intervals, allowing deposition rate to be mapped to positional coordinates and providing a new data stream to drive quality control assessments. Because light scattering measurements are indicative of a physical process parameter, they were substituted into equations for resistance and sheet resistance, resulting in predictions nominally within 10% of measured values for sets of printed devices. Finally, to highlight a more active utility, light scattering measurements were employed in a print repair framework, successfully repairing prints with randomly induced defects to within 5% of the measured resistance of a control set.

36 MATERIALS SCIENCE↗

Hydration of a Side-Chain-Free n-Type Semiconducting Ladder Polymer Driven by Electrochemical Doping

Here, we study the organic electrochemical transistors (OECTs) performance of the ladder polymer, poly(benzimidazobenzophenanthroline) (BBL) in an attempt to better understand how an apparently hydrophobic side-chain-free polymer is able to operate as an OECT with favorable redox kinetics in an aqueous environment. We examine two BBLs of different molecular masses from different sources. Both BBLs show significant film swelling during the initial reduction step. By combining electrochemical quartz crystal microbalance (eQCM) gravimetry, in-operando atomic force microscopy (AFM), and both ex-situ and in-operando grazing incidence wide-angle x-ray scattering (GIWAXS), we provide a detailed structural picture of the electrochemical charge injection process in BBL in the absence of any hydrophilic side-chains. Compared with ex-situ measurements, inoperando GIWAXS shows both more swelling upon electrochemical doping than has previously been recognized, and less contraction upon dedoping. The data show that BBL films undergo an irreversible hydration driven by the initial electrochemical doping cycle with significant water retention and lamellar expansion that persists across subsequent oxidation/reduction cycles. This swelling creates a hydrophilic environment that facilitates the subsequent fast hydrated ion transport in the absence of the hydrophilic side-chains used in many other polymer systems. Due to its rigid ladder backbone and absence of hydrophilic side-chains, the primary BBL water uptake does not significantly degrade the crystalline order, and the original dehydrated, unswelled state can be recovered after drying. The combination of doping induced hydrophilicity and robust crystalline order leads to efficient ionic transport and good stability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The Inner Shell Spectroscopy beamline at NSLS-II: a facility for in situ and operando X-ray absorption spectroscopy for materials research

The Inner Shell Spectroscopy (ISS) beamline on the 8-ID station at the National Synchrotron Light Source II (NSLS-II), Upton, NY, USA, is a high-throughput X-ray absorption spectroscopy beamline designed for in situ, operando, and time-resolved material characterization using high monochromatic flux and scanning speed. This contribution discusses the technical specifications of the beamline in terms of optics, heat load management, monochromator motion control, and data acquisition and processing. Results of the beamline tests demonstrating the quality of the data obtainable on the instrument, possible energy scanning speeds, as well as long-term beamline stability are shown. The ability to directly control the monochromator trajectory to define the acquisition time for each spectral region is highlighted. Examples of studies performed on the beamline are presented. The paper is concluded with a brief outlook for future developments.

36 MATERIALS SCIENCE↗

Distributed Coaxial Cable Sensors for In-Situ Condition Based Monitoring of Coal-Fired Boiler Tubes

The increasing contributions of renewable energy sources present new challenges to the operation and maintenance of the existing coal-fired power plants. One of the major operational risks is the unexpected failure of superheater boiler tubes, leading to the most unplanned power plant outrages. The boiler tube failure is difficult to predict due to the harsh operating environments. Therefore, condition-based monitoring (CBM) with a reliable high temperature sensor becomes necessary to produce a meaningful assessment of the health condition of boiler tubes and their remaining lifetime. In this work, the stainless-steel and quartz coaxial cable sensor (SSQ-CCS) is proposed for in-situ distributed monitoring of the boiler tube temperatures in existing coal-fired power plants. Comprehensive tests have been conducted with an in-house testing facility at Clemson University to study and evaluate the sensors’ performance in the temperature range of 100℃ to 600℃. The results indicated that the measurement resolution of the SSQ-CCS sensor is better than 1℃, and the drift is less than 2% over long-period testing. Meanwhile, multi-physics finite element analysis has been conducted to optimize the design and evaluate the safety of the SSQ-CCS temperature sensor under various operational conditions. Based on the performance obtained in the laboratory-scale testing, a field test has been implemented at a power plant. Four SSQ-CCS temperature sensors were installed for in-situ monitoring of the temperatures of a power plant’s superheat tube assembles. The data acquisition system has been successfully set up and collected sensing signals for more than three months. The sensing signals have been post-processed, and the monitored temperature history through the SSQ-CCS temperature sensor has been validated and compared with the conventional high temperature thermal couple data.

Jiao, Xinyu↗

High concentrations of ice: Investigations using polarimetric radar observations combined with in situ measurements and cloud modeling (Final Report)

This DOE-funded joint project had the over-arching goal of understanding the reasons for observed size distributions of ice particles in cold clouds. Its approach involves the use of cloud models and field observations by radar and aircraft of real storms. The project addresses three major research objectives: (1) Utilize a novel polarimetric radar technique to retrieve size distributions and amounts of ice from radar data collected during the previous DOE ARM field campaigns; (2) Evaluate the results of ice microphysical retrievals using available in situ aircraft measurements and other remote sensors (e.g., vertically pointing cloud radars and wind profilers); (3) Improve the treatment of microphysical processes leading to cloud glaciation and ice multiplication in numerical cloud models. The study was performed by three research organizations: University of Oklahoma, The Hebrew University of Jerusalem, Israel, and Lund University, Sweden. The Israel and Swedish partners were funded by the sub-awards from the University of Oklahoma. Cloud modeling studies have been performed by the research teams at The Hebrew University of Jerusalem (HUJ) and Lund University to identify the origins of high concentrations of cloud ice in areas of high ice water content (HIWC). The Hebrew University Cloud Model (HUCM) with full spectral bin microphysics and the Lund University aerosol-cloud (AC) model with a hybrid bin / bulk microphysics scheme complementing HUCM were utilized for simulations. Both research teams had particular focus on secondary ice production (SIP) as one of the possible sources of enhanced ice concentration. The HUJ group suggested a novel concept of ice multiplication during droplet freezing. It is assumed that splintering and droplet fragmentation during droplet freezing takes place because of dendritic growth within a supercooled drop. The resulting simulations of SIP generated small ice in concentrations exceeding hundreds per liter similar to what was observed in the HIWC regions of the tropical storms. The Lund team explored the SIP mechanisms such as breakup of ice particles due to ice-ice collisions and ice sublimation that are expected to dominate the continental storms. They also quantified the impact of homogeneous nucleation of cloud droplets on the total number concentration of ice at very low temperatures near the tops of the clouds. Additionally, the Lund AC model is able to simulate the effect of aerosols of various types (including biological) on the cloud life cycle and the corresponding ice production. The HUCM / AC model was used to simulate one of the “golden” cases of the DOE MC3E campaign on 20 May 2011. The model output was converted into the fields of polarimetric radar variables using the polarimetric radar forward operator developed at the University of Oklahoma and compared with radar observations and in situ microphysical measurements onboard research aircraft. It was demonstrated that specific differential phase KDP is the best radar parameter to identify the HIWC areas and quantify the corresponding ice parameters. For the first time, the shape of the vertical profile of KDP was realistically reproduced by the cloud model with the KDP maximum in the dendritic growth layer (DGL) centered at the -15°C isotherm. The University of Oklahoma team has developed a methodology for polarimetric radar retrievals of such microphysical parameters of ice as ice water content (IWC), mean volume diameter (Dm), and total number concentration (Nt) of ice particles. These retrievals have been validated using in situ aircraft measurements during 6 field campaigns and proved to be quite robust and reliable. This allowed to build the first climatology of the vertical profiles of polarimetric radar variables and retrieved microphysical parameters for the three types of weather systems: continental MCSs, maritime MCSs, and tropical cyclones / hurricanes (Hu and Ryzhkov 2022). The data were collected by a multitude of the WSR-88D radars in 13 continental and 10 maritime MCSs and 11 landfalling hurricanes. The HIWC areas were identified within the examined storms and the corresponding “HIWC statistics” was compared with the “background” one without HIWC. An overarching conclusion of the study is that maritime tropical storms (MCSs and hurricanes) are characterized by smaller size ice in higher concentration compared to the continental MCSs. High ice water content in the HIWC areas is primarily caused by a strong jump in a number concentration of ice particles rather than the increase of their size compared to the “background” environment. This may point to the homogeneous nucleation of excessive amounts of supercooled droplets and / or secondary ice production as the possible origins of HIWC. Such a climatology provides a good observational reference for the modelers to evaluate the performance of their models. As an example, the in-depth analysis of the 20 May 2011 MC3E case shows that the advanced cloud models developed in the course of this study still tend to underestimate the number concentration of ice in the HIWC areas although they succeed in reproducing realistically looking vertical profiles of IWC and Nt. The results of the project research are summarized in 13 journal papers.

54 ENVIRONMENTAL SCIENCES↗

Conserving Land–Atmosphere Synthesis Suite (CLASS)

Accurate estimates of terrestrial water and energy cycle components are needed to better understand climate processes and improve models’ ability to simulate future change. Various observational estimates are available for the individual budget terms; however, these typically show inconsistencies when combined in a budget. In this work, a Conserving Land–Atmosphere Synthesis Suite (CLASS) of estimates of simultaneously balanced surface water and energy budget components is developed. Individual CLASS variable datasets, where possible, 1) combine a range of existing variable product estimates, and hence overcome the limitations of estimates from a single source; 2) are observationally constrained with in situ measurements; 3) have uncertainty estimates that are consistent with their agreement with in situ observations; and 4) are consistent with each other by being able to solve the water and energy budgets simultaneously. First, available datasets of a budget variable are merged by implementing a weighting method that accounts both for the ability of datasets to match in situ measurements and the error covariance between datasets. Then, the budget terms are adjusted by applying an objective variational data assimilation technique (DAT) that enforces the simultaneous closure of the surface water and energy budgets linked through the equivalence of evapotranspiration and latent heat. Comparing component estimates before and after applying the DAT against in situ measurements of energy fluxes and streamflow showed that modified estimates agree better with in situ observations across various metrics, but also revealed some inconsistencies between water budget terms in June over the higher latitudes.

54 ENVIRONMENTAL SCIENCES↗

Effect of threshold parameters on infrared segmentation methods for porosity detection in electron beam powder bed fusion

In-situ process monitoring has seen significant interest in additive manufacturing to address qualification and certification goals. This is especially prevalent in metal powder bed fusion processes such as electron beam powder bed fusion (PBF-EB), with layer-wise infrared imaging being commonly used to detect defects. Here, this work compares two different segmentation methods (static thresholding and statistical thresholding) used for detecting porosity from in-situ infrared imaging data for PBF-EB. Samples were manufactured at a variety of focus offset values to induce porosity. Then, the segmented infrared images were compared to ex-situ X-ray computed tomography scans, which served as a ground-truth reference for objective evaluation. Through this analysis framework, the influential parameters, static threshold and N-value (number of standard deviations above the mean pixel value), respectively, for both image segmentation methods were analyzed and compared for their effects on porosity detection. With optimal parameter settings, the two methods had similar porosity detection performance, but the statistical method performed better under a larger variety of parameter settings.

Infrared imaging↗

Changes in soil pore structure generated by the root systems of maize , sorghum and switchgrass affect in situ N 2 O emissions and bacterial denitrification

Due to the heterogeneous nature of soil pore structure, processes such as nitrification and denitrification can occur simultaneously at microscopic levels, making prediction of small-scale nitrous oxide (N 2 O) emissions in the field notoriously difficult. We assessed N 2 O+N 2 emissions from soils under maize (Zea mays L.), switchgrass (Panicum virgatum L.), and energy sorghum (Sorghum bicolor L.), three potential bioenergy crops in order to identify the importance of different N 2 O sources to microsite production, and relate N 2 O source differences to crop-associated differences in pore structure formation. The combination of isotopic surveys of N 2 O in the field during one growing season and X-ray computed tomography (CT) enabled us to link results from isotopic mappings to soil structural properties. Further, our methodology allowed us to evaluate the potential for in situ N 2 O suppression by biological nitrification inhibition (BNI) in energy sorghum. Our results demonstrated that the fraction of N 2 O originating from bacterial denitrification and reduction of N 2 O to N 2 is largely determined by the volume of particulate organic matter occluded within the soil matrix and the anaerobic soil volume. Bacterial denitrification was greater in switchgrass than in the annual crops, related to changes in pore structure caused by the coarse root system. This led to high N-loses through N 2 emissions in the switchgrass system throughout the season a novel finding given the lack of data in the literature for total denitrification. Isotopic mapping indicated no differences in N 2 O-fluxes or their source processes between maize and energy sorghum that could be associated with the release of BNI by the investigated sorghum variety. The results of this research show how differences in soil pore structures among cropping systems can determine both N 2 O production via denitrification and total denitrification N losses in situ.

59 BASIC BIOLOGICAL SCIENCES↗

Regulators of early maize leaf development inferred from transcriptomes of laser capture microdissection (LCM)-isolated embryonic leaf cells

The superior photosynthetic efficiency of C 4 leaves over C 3 leaves is owing to their unique Kranz anatomy, in which the vein is surrounded by one layer of bundle sheath (BS) cells and one layer of mesophyll (M) cells. Kranz anatomy development starts from three contiguous ground meristem (GM) cells, but its regulators and underlying molecular mechanism are largely unknown. To identify the regulators, we obtained the transcriptomes of 11 maize embryonic leaf cell types from five stages of pre-Kranz cells starting from median GM cells and six stages of pre-M cells starting from undifferentiated cells. Principal component and clustering analyses of transcriptomic data revealed rapid pre-Kranz cell differentiation in the first two stages but slow differentiation in the last three stages, suggesting early Kranz cell fate determination. In contrast, pre-M cells exhibit a more prolonged transcriptional differentiation process. Differential gene expression and coexpression analyses identified gene coexpression modules, one of which included 3 auxin transporter and 18 transcription factor (TF) genes, including known regulators of Kranz anatomy and/or vascular development. In situ hybridization of 11 TF genes validated their expression in early Kranz development. We determined the binding motifs of 15 TFs, predicted TF target gene relationships among the 18 TF and 3 auxin transporter genes, and validated 67 predictions by electrophoresis mobility shift assay. From these data, we constructed a gene regulatory network for Kranz development. Our study sheds light on the regulation of early maize leaf development and provides candidate leaf development regulators for future study.

59 BASIC BIOLOGICAL SCIENCES↗

Experimental analysis of conductive drying of paper and board

The primary heat transfer source in the conventional multi-cylinder drying of paper and board is conduction. Conduction is facilitated by high-tension contact with steam-heated cylinders, while convective drying, the main mass transfer source, operates as heated air flows over the paper web in the pockets. This conduction process occurs at elevated temperatures and contact pressures to ensure effective contact between the wet paper web and the heated cylinders. The contact pressures and temperatures of the hot surface significantly influence the conductive drying characteristics. This research paper presents an experimental study that involves designing a simple lab-scale setup with in-situ and continuous sensing capabilities for various commercially available grades of paper and board. Embedded thermocouples measure the temperatures of the heated platen and the sheet, allowing the collection of flux data to determine heat transfer characteristics. Here, the goal of this study is to ascertain the instantaneous contact coefficients for different basis weights as a function of moisture content. The acquired data will provide valuable insights and information towards process development, design and simulation of the paper drying process.

42 ENGINEERING↗

The effect of WAAM process parameters on process conditions and production metrics in the fabrication of single-pass multi-layer wall artifacts

The present work seeks to understand the impact of varying dwell time and input deposition power on part quality and overall production time for wire arc additive manufacturing. In this work, multi-layer wall geometries were deposited under different input power conditions without affecting the material deposition rate by setting traverse speed and wire feed speed constant and varying the contact tip-to-workpiece distance and the deposition power settings. Current and voltage data and optical imaging of the deposition zone were captured in situ, and wall geometry was characterized using laser scanning, so to understand the applicability of these methods for determining part height in situ. Furthermore, the present results demonstrate that alternating dwell times with lower input deposition power can result in significantly reduced overall production time and minimal material underbuilding, despite increased deposition geometry width. Furthermore, it is shown that while elimination of process dwell results in severe underbuilding of the deposition, it also yields the highest production rate for a hybrid-finished (e.g., deposited, machined) wall in terms of mm in build direction per minute and the highest buy-to-fly ratio.

36 MATERIALS SCIENCE↗

The Exploitation of Data Reduction for Visualization

The disparity between the computational speed and storage bandwidth, as demonstrated in Figure 1, is a well known problem that grows with each successive generation. The visualization community is principally responding to this issue by using in situ to reduce which data must be written to storage. However, other communities are taking different, possibly complementary approaches. In particular, data compression is a common general approach to reduce storage demands. Data compression technologies are typically not designed with post processing in mind. The principal metrics measured are compression ratio, the improved bandwidth to storage, and the error introduced. It is assumed that data is inflated to its full size before any post processing can happen. Although when talking about bandwidth disparities, HPC’s dirty little secret is that no part of the memory nor interconnect hardware is increasing at the rate of computation. For example, the Summit supercomputer has a peak computation rate almost 10 times its predecessor, Titan, but only about 4 times the memory, less than twice the aggregate memory bandwidth, and almost no improvement in the interconnect bisection bandwidth. Naively inflating data for post processing does not help with limitations in the memory and interconnect systems.

97 MATHEMATICS AND COMPUTING↗