Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PRESERVATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Sharing the Preservation Burden

Preserving digitally encoded information which is not just to be rendered, as a document, but which must processed, like data, is even harder than one might think, because understandability of the information which is encoded in the digital object(s) is what is required. Information about Nuclear Waste will include both documents as well as data. Moreover one must be able to understand the relationship between the many individual pieces of information. Furthermore the volume of information involved will require us to allow automated processing of such information. Preserving the ability to understand and process digitally encoded information over long periods of time is especially hard when so many things will change, including hardware, software, environment and the tacit and implicit knowledge that people have. Since we cannot predict these changes this cannot be just a one-off action; continued effort is required. However it seems reasonable to say that no organization, project or person can ever say for certain that their ability to provide this effort is going to last forever. What can be done? Can anything be guaranteed? Probably not guaranteed - but at least one can try to reduce the risk of losing the information. We argue that if no single organization, project or person can guarantee funding or effort (or even interest), then somehow we must share the 'preservation load', and this is more than a simple chain of preservation consisting of handing on the collection of bits from one holder to the next. Clearly the bits must be passed on (but may be transformed along the way), however something more is required - because of the need to maintain understandability, not just access. This paper describes the tools, techniques and infrastructure components which the CASPAR project is producing to help in sharing the preservation burden. In summary: CASPAR is attempting to use OAIS concepts rigorously and to the fullest extent possible, supplementing these where appropriate. Based on these fundamental ideas about digital preservation, a number of components, tools and techniques are being created in order to provide a broadly applicable infrastructure to allow the spreading of the burden of preserving the understandability and usability of digitally encoded information. In the process the limits of the applicability of these OAIS concepts are themselves being tested. Most importantly a number of validation metrics have been produced. Further details are available from the CASPAR web site http://www.casparpreserves.eu. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Maximum bound principle preserving integrating factor Runge–Kutta methods for semilinear parabolic equations

A large class of semilinear parabolic equations satisfy the maximum bound principle (MBP) in the sense that the time-dependent solution preserves for any time a uniform pointwise bound imposed by its initial and boundary conditions. Here, the MBP plays a crucial role in understanding the physical meaning and the well-posedness of the mathematical model. Investigation on numerical algorithms with preservation of the MBP has attracted increasingly attentions in recent years, especially for the temporal discretizations, since the violation of MBP may lead to nonphysical solutions or even blow-ups of the algorithms. In this paper, we study high-order MBP-preserving time integration schemes by means of the integrating factor Runge-Kutta (IFRK) method. Beginning with the space-discrete system of semilinear parabolic equations, we present the IFRK method in general form and derive the sufficient conditions for the method to preserve the MBP. In particular, we show that the classic four-stage, fourth-order IFRK scheme is MBP preserving for some typical semilinear systems although not strong stability preserving, which can be instantly applied to the Allen-Cahn type of equations. To our best knowledge, this is the first time to present a fourth-order linear numerical method preserving the MBP. In addition, convergence of these numerical schemes is proved theoretically and verified numerically, as well as their efficiency by simulations of 2D and 3D long-time evolutional behaviors. Numerical experiments are also carried out for a model which is not a typical gradient flow as the Allen-Cahn type of equations.

97 MATHEMATICS AND COMPUTING↗

Realizability-preserving discontinuous Galerkin method for spectral two-moment radiation transport in special relativity

Here we present a realizability-preserving numerical method for solving a spectral two-moment model to simulate the transport of massless, neutral particles interacting with a steady background material moving with relativistic velocities. The model is obtained as the special relativistic limit of a four-momentum-conservative general relativistic two-moment model. Using a maximum-entropy closure, we solve for the Eulerian-frame energy and momentum. The proposed numerical method is designed to preserve moment realizability, which corresponds to moments defined by a nonnegative phase-space density. The realizability-preserving method is achieved with the following key components: (i) a discontinuous Galerkin phase-space discretization with specially constructed numerical fluxes in the spatial and energy dimensions; (ii) a strong stability-preserving implicit-explicit time-integration method; (iii) a realizability-preserving conserved to primitive moment solver; (iv) a realizability-preserving implicit collision solver; and (v) a realizability-enforcing limiter. Component (iii) is necessitated by the closure procedure, which closes higher order moments nonlinearly in terms of primitive moments. The nonlinear conserved to primitive and the implicit collision solves are formulated as fixed-point problems, which are solved with custom iterative solvers designed to preserve the realizability of each iterate. With a series of numerical tests, we demonstrate the accuracy and robustness of this discontinuous-Galerkin-implicit-explicit method.

79 ASTRONOMY AND ASTROPHYSICS↗

A Proposed Geospatial Data Preservation Strategy for DOE's Office of Legacy Management

Identifying and planning preservation and curation activities associated with geospatial data will improve the ability of the U.S. Department of Energy Office of Legacy Management (LM) to support their core mission of protecting human health and the environment. This report documents the development LM's strategy for preserving and curating geospatial data within the context of LM's data-lifecycle-management framework. The strategy consists of preservation and curation elements, specific activities, and key enabling factors that ensure LM's geospatial data is maintained. Preservation elements enable the effective preservation of LM's geospatial data and recognizes that strategies need to be flexible to adapt to ongoing changes in scale, technology, and standards. Key enabling factors are intended to highlight critical data management responsibilities that must be addressed by LM to meet its preservation and curation objectives. A summary of best practices for geospatial data preservation is provided as part of the strategy.

97 MATHEMATICS AND COMPUTING↗

Independent Evidence for the Preservation of Endogenous Bone Biochemistry in a Specimen of Tyrannosaurus rex

Biomolecules preserved in deep time have potential to shed light on major evolutionary questions, driving the search for new and more rigorous methods to detect them. Despite the increasing body of evidence from a wide variety of new, high resolution/high sensitivity analytical techniques, this research is commonly met with skepticism, as the long standing dogma persists that such preservation in very deep time (>1 Ma) is unlikely. The Late Cretaceous dinosaur Tyrannosaurus rex (MOR 1125) has been shown, through multiple biochemical studies, to preserve original bone chemistry. Here, we provide additional, independent support that deep time bimolecular preservation is possible. We use synchrotron X-ray fluorescence imaging (XRF) and X-ray absorption spectroscopy (XAS) to investigate a section from the femur of this dinosaur, and demonstrate preservation of elements (S, Ca, and Zn) associated with bone remodeling and redeposition. We then compare these data to the bone of an extant dinosaur (bird), as well as a second non-avian dinosaur, Tenontosaurus tilletti (OMNH 34784) that did not preserve any sign of original biochemistry. Our data indicate that MOR 1125 bone cortices have similar bone elemental distributions to that of an extant bird, which supports preservation of original endogenous chemistry in this specimen.

59 BASIC BIOLOGICAL SCIENCES↗

A review of high order strong stability preserving two-derivative explicit, implicit, and IMEX methods

High order strong stability preserving time discretizations ensure the nonlinear non-inner-product strong stability properties of spatial discretizations suited for the stable simulation of hyperbolic PDEs in a wide variety of application areas including fluid dynamics, magnetohydrodynamics, semiconductor devices, electromagnetics, and astrophysics. Over the past decade multiderivative time-stepping have been increasingly used for the time-evolution hyperbolic PDEs, so that the strong stability properties of these methods have become important. In this work we review sufficient conditions for a two-derivative multistage method to preserve the strong stability properties of spatial discretizations in a forward Euler and different conditions on the second derivative. In particular we present the strong stability preserving theory for explicit and implicit two-derivative Runge–Kutta schemes, including a special condition on the second derivative under which these implicit methods may be unconditionally strong stability preserving. This special condition is natural for the stiff component of wide range of plasma physics problems, and can be useful in the context of strong stability preserving implicit-explicit multi-derivative Runge–Kutta schemes, where the time-step restriction is then independent of the stiff term. Lastly, we present the strong stability preserving theory for implicit-explicit multi-derivative general linear methods, and some novel second and third order methods where the time-step restriction is independent of the stiff term.

97 MATHEMATICS AND COMPUTING↗

Data Preservation in High Energy Physics

Data from high-energy physics (HEP) experiments are collected with significant financial and human effort and are mostly unique. At the same time, HEP has no coherent strategy for data preservation and re-use. An inter-experimental Study Group on HEP data preservation and long-term analysis was convened at the end of 2008 and held two workshops, at DESY (January 2009) and SLAC (May 2009). This document is an intermediate report to the International Committee for Future Accelerators (ICFA) of the reflections of this Study Group. Large data sets accumulated during many years of detector operation at particle accelerators are the heritage of experimental HEP. These data sets offer unique opportunities for future scientific studies, sometimes long after the shut-down of the actual experiments: new theoretical input; new experimental results and analysis techniques; the quest for high-sensitivity combined analyses; the necessity of cross checks. In many cases, HEP data sets are unique; they cannot and most likely will not be superseded by data from newer generations of experiments. Once lost, or in an unusable state, HEP data samples cannot be reasonably recovered. The cost of conserving this heritage through a collaborative, target-oriented long-term data preservation program would be small, compared to the costs of past experimental projects or to the efforts to re-do experiments. However, this cost is not negligible, especially for collaborations close or past their end-date. The preservation of HEP data would provide today's collaborations with a secure way to complete their data analysis and enable them to seize new scientific opportunities in the coming years. The HEP community will benefit from preserved data samples through reanalysis, combination, education and outreach. Funding agencies would receive more scientific return, and a positive image, from their initial investment leading to the production and the first analysis of preserved data.

43 PARTICLE ACCELERATORS↗

Enabling Computation on Sensitive Data in International Safeguards with Privacy-Preserving Encryption Techniques

Privacy-preserving machine learning is a field of study that explores how to protect and preserve the privacy of sensitive data while allowing the data to be used by machine learning algorithms. This field has had substantial industry investment due to heightened concerns about privacy in the technology industry, with a focus in two broad application areas: financial services and healthcare. Numerous privacy-preserving methods have also been proposed for international safeguards, but they have been difficult to enact because the data they require is con- sidered sensitive or proprietary by the nuclear facility operator. This work examines how current privacy-preserving approaches might be used to enable the International Atomic Energy Agency (IAEA) to use that data to contribute to a safeguards conclusion about a state while giving nuclear operators confidence that their sensitive data is adequately protected. This paper begins by exploring several broad categories of privacy-preserving techniques including homomorphic encryption, secure multiparty computation, secure enclaves, and zero-knowledge proofs. Then we discuss some of the security considerations related to using these methods, potential use cases, and a conceptual system design for applying privacy-preserving methods in international safeguards.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Preservation of Records, Knowledge and Memory Across Generations. An emerging Multidisciplinary Work Area and an NEA Project - 12218

Disposal in engineered facilities built in stable, deep geological formations is the reference means for permanently isolating long-lived radioactive waste from the human biosphere. This management method is designed to be intrinsically safe and final, i.e. not dependent on human presence and intervention in order to fulfil its safety goal. There is however no intention to forgo, at any time, knowledge and awareness either of the repository or of the waste that it contains. The preservation of Records, Knowledge and Memory (RK and M) is seen as an integral part of radioactive waste management, supporting lengthy and complex socio-technical processes across pre-operational, operational and post-operational lifetimes. Long-term preservation of RK and M is an emerging multidisciplinary work area in which much learning is expected over the coming years. Novel methods are being sought that are least vulnerable to both natural degradation and to changes in socio-economic conditions. Progress has been made in individual countries, but there is a need to internationalise the thinking, compare approaches, investigate potential solutions and share decisions. This is the task of the NEA RK and M project. A major outcome of the project will be a 'menu-driven document' that will allow people to identify the main elements of a strategic action plan for RK and M preservation. In sum, the preservation of RK and M is a unprecedented task in which technical, scientific and social information is interwoven and needs to be developed and preserved across generations and across specialist boundaries. Important studies have been undertaken in the past decades to explore a variety of approaches to preserving RK and M across different timescales, including archives and markers. The work of the past in this area is useful, but innovative thinking is also needed. Seen from today's perspective, very little work is available on for example the contextualization of data for later use; on the systematic identification of mechanisms for RK and M transfer; on implementing a culture of RK and M-keeping in organisations; and on creating cultural links between the waste disposals and the siting communities. Moreover, international cooperation is recognised as being crucial in providing shared means and meanings for memory transmission over longer timescales. International cooperation has also been identified as a catalyst to ensure that a wide range of approaches and experiences is considered, thus potentially reducing uncertainty related to variations in approach. Overall, multiple approaches, requiring active and less active care, need to be considered from the start of the radioactive waste management programme and refined in the course of time. The RK and M project members want to further investigate and deliver support to fulfil this task. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Structure and structure-preserving algorithms for plasma physics

Hamiltonian and action principle (HAP) formulations of plasma physics are reviewed for the purpose of explaining structure preserving numerical algorithms. Geometric structures associated with and emergent from HAP formulations are discussed. These include conservative integration, which exactly conserves invariants, symplectic integration, which exactly preserves the Hamiltonian geometric structure, and other Hamiltonian integration techniques. Basic ideas of variational integration and Poisson integration, which can preserve the noncanonical Hamiltonian structure, are discussed. Metriplectic integration, which preserves the structure of conservative systems with both Hamiltonian and dissipative parts, is proposed. Two kinds of simulated annealing, a relaxation technique for obtaining equilibrium states, are reviewed: one that uses metriplectic dynamics, which maximizes an entropy at fixed energy, and the other that uses double bracket dynamics, which preserves Casimir invariants. Throughout, applications to plasma systems are emphasized. The paper concludes with a discussion of geometric electromagnetic particle-in-cell [Kraus et al., J. Plasma Phys. (to be published); e-print arXiv:1609.03053v1 [math.NA]], a particle in cell code that incorporates Hamiltonian and geometrical structure preserving properties.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Limited influence of Si on the preservation of Fe mineral‐encrusted microbial cells during experimental diagenesis

Abstract The reconstruction of the history of microbial life since its emergence on early Earth is impaired by the difficulty to prove the biogenicity of putative microfossils in the rock record. While most of the oldest rocks on Earth have been exposed to different grades of diagenetic alterations, little is known about how the remains of micro‐organisms evolve when exposed to pressure (P) and temperature (T) conditions typical of diagenesis. Using spectroscopy and microscopy, we compared morphological, mineralogical, and chemical biosignatures exhibited by Fe mineral‐encrusted cells of the bacterium Acidovorax sp. BoFeN1 after long‐term incubation under ambient conditions and after experimental diagenesis. We also evaluated the effects of Si on the preservation of microbial cells during the whole process. At ambient conditions, Si affected the morphology but not the identity (goethite) of Fe minerals that formed around cells. Fe‐encrusted cells were morphologically well preserved after 1 week at 250 °C‐140 MPa and after 16 weeks at 170 °C‐120 MPa in the presence or in the absence of Si. Some goethite transformed to hematite and magnetite at 250 °C‐140 MPa, but in the presence of Si more goethite was preserved. Proteins—the most abundant cellular components—were preserved over several months at ambient conditions but disappeared after incubations at high temperature and pressure conditions, both in the presence and in the absence of Si. Other organic compounds, such as lipids and extracellular polysaccharides seemed well preserved after exposure to diagenetic conditions. This study provides insights about the composition and potential preservation of microfossils that could have formed in Fe‐ and Si‐rich Precambrian oceans.

Picard, A.↗

MO-FG-204-03: Using Edge-Preserving Algorithm for Significantly Improved Image-Domain Material Decomposition in Dual Energy CT

Purpose: To significantly improve dual energy CT (DECT) imaging by establishing a new theoretical framework of image-domain material decomposition with incorporation of edge-preserving techniques. Methods: The proposed algorithm, HYPR-NLM, combines the edge-preserving non-local mean filter (NLM) with the HYPR-LR (Local HighlY constrained backPRojection Reconstruction) framework. Image denoising using HYPR-LR framework depends on the noise level of the composite image which is the average of the different energy images. For DECT, the composite image is the average of high- and low-energy images. To further reduce noise, one may want to increase the window size of the filter of the HYPR-LR, leading resolution degradation. By incorporating the NLM filtering and the HYPR-LR framework, HYPR-NLM reduces the boost material decomposition noise using energy information redundancies as well as the non-local mean. We demonstrate the noise reduction and resolution preservation of the algorithm with both iodine concentration numerical phantom and clinical patient data by comparing the HYPR-NLM algorithm to the direct matrix inversion, HYPR-LR and iterative image-domain material decomposition (Iter-DECT). Results: The results show iterative material decomposition method reduces noise to the lowest level and provides improved DECT images. HYPR-NLM significantly reduces noise while preserving the accuracy of quantitative measurement and resolution. For the iodine concentration numerical phantom, the averaged noise levels are about 2.0, 0.7, 0.2 and 0.4 for direct inversion, HYPR-LR, Iter- DECT and HYPR-NLM, respectively. For the patient data, the noise levels of the water images are about 0.36, 0.16, 0.12 and 0.13 for direct inversion, HYPR-LR, Iter-DECT and HYPR-NLM, respectively. Difference images of both HYPR-LR and Iter-DECT show edge effect, while no significant edge effect is shown for HYPR-NLM, suggesting spatial resolution is well preserved for HYPR-NLM. Conclusion: HYPR-NLM provides an effective way to reduce the generic magnified image noise of dual–energy material decomposition while preserving resolution. This work is supported in part by NIH grants 7R01HL111141 and 1R01-EB016777. This work is also supported by the Natural Science Foundation of China (NSFC Grant No. 81201091), Fundamental Research Funds for the Central Universities in China, and Fund Project for Excellent Abroad Scholar Personnel in Science and Technology.

60 APPLIED LIFE SCIENCES↗

A positivity-preserving and conservative intersection-distribution-based remapping algorithm for staggered ALE hydrodynamics on arbitrary meshes

In this study, we introduce new intersection-distribution-based remapping tools for indirect staggered arbitrary Lagrangian-Eulerian (ALE) simulations of multi-material shock hydrodynamics on arbitrary meshes. In addition to conserving momentum and total energy, the three-stage remapper proposed in this work preserves non-negativity of the internal energy. At the first stage, we construct slope-limited piecewise-linear reconstructions of all conserved quantities on zones of the source mesh and perform intersection-based remap to obtain bound-preserving zonal quantities on the target mesh. At the second stage, we define bound-preserving nodal quantities of the staggered ALE discretization as convex combinations of corner quantities. The nodal internal energy is corrected in a way which keeps it non-negative, while providing exact conservation of total energy. At the final stage, we distribute the non-negative nodal internal energy to corners, zones and materials using non-negative weights. Proofs of positivity preservation are provided for each stage. This work is a natural extension of our paper [14] in which a similar intersection-distribution-based remapping procedure was employed. The original version used a nodal kinetic energy fix which did not provably ensure positivity preservation for the zonal internal energy after the final distribution stage. The new algorithm cures this potential drawback by using ‘coordinated’ limiters for piecewise-linear reconstructions, remapping the internal energy to nodes and correcting it before redistribution. The effectiveness of the new nodal fix is illustrated by numerical examples.

97 MATHEMATICS AND COMPUTING↗

Structure preserving transport stabilized compatible finite element methods for magnetohydrodynamics

Here, we present compatible finite element space discretizations for the ideal compressible magnetohydrodynamic equations. The magnetic field is considered both in div- and curl-conforming spaces, leading to a strongly or weakly preserved zero-divergence condition, respectively. The equations are discretized in space such that transfers between the kinetic, internal, and magnetic energies are consistent, leading to a preserved total energy. We also discuss further adjustments to the discretization required to additionally achieve magnetic helicity preservation. Finally, we describe new transport stabilization methods for the magnetic field equation which maintain the zero-divergence and energy conservation properties, including one method which also preserves magnetic helicity. The methods' preservation and improved stability properties are confirmed numerically using a steady state and a magnetic dynamo test case.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Preserving Lagrangian Structure in Nonlinear Model Reduction with Application to Structural Dynamics

Our work proposes a model-reduction methodology that preserves Lagrangian structure and achieves computational efficiency in the presence of high-order nonlinearities and arbitrary parameter dependence. As such, the resulting reduced-order model retains key properties such as energy conservation and symplectic time-evolution maps. We focus on parameterized simple mechanical systems subjected to Rayleigh damping and external forces, and consider an application to nonlinear structural dynamics. To preserve structure, the method first approximates the system's “Lagrangian ingredients''---the Riemannian metric, the potential-energy function, the dissipation function, and the external force---and subsequently derives reduced-order equations of motion by applying the (forced) Euler--Lagrange equation with these quantities. Moreover, from the algebraic perspective, key contributions include two efficient techniques for approximating parameterized reduced matrices while preserving symmetry and positive definiteness: matrix gappy proper orthogonal decomposition and reduced-basis sparsification. Our results for a parameterized truss-structure problem demonstrate the practical importance of preserving Lagrangian structure and illustrate the proposed method's merits: it reduces computation time while maintaining high accuracy and stability, in contrast to existing nonlinear model-reduction techniques that do not preserve structure.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Experimental Preservation of Muscle Tissue in Quartz Sand and Kaolinite

Siliciclastic sediments of the Ediacaran Period contain exceptionally preserved fossils of macroscopic organisms, including three-dimensional casts and molds commonly found in sandstones and siltstones and some two-dimensional compressions reported in shales. The sporadic and variable associations of these exceptionally preserved macroscopic fossils with pyrite, clay minerals, and microbial fossils and textures complicate our understanding of fossilization processes. This hinders inferences about the evolutionary histories, tissue types, original morphologies, and lifestyles of the enigmatic Ediacara biota. In this work, we investigate the delayed decay of scallop muscles buried in quartz sand or kaolinite for 45 days. This process occurs in the presence of microbial activity in mixed redox environments, but in the absence of thick, sealing microbial mats. Furthermore, microbial processes that mediate organic decay and release the highest concentrations of silica and Fe(II) into the pore fluids are associated with the most extensive tissue decay. Delayed decay and the preservation of thick muscles in sand are associated with less intense microbial iron reduction and the precipitation of iron oxides and iron sulfides that contain Fe(II) or Fe(III). In contrast, muscles buried in kaolinite are coated only by <10 μm-thick clay veneers composed of kaolinite grains and newly formed K- and Fe(II)-rich aluminosilicate phases. Muscles that undergo delayed decay in kaolinite lose more mass relative to the muscles buried in sand and undergo vertical collapse. These findings show that the composition of minerals that coat or precipitate within the tissues and the vertical dimension of the preserved features can depend on the type of sediment that buries the muscles. Similar processes in the zone of oscillating redox likely facilitated the formation of exceptionally preserved macrofossils in Ediacaran siliciclastic sediments.

58 GEOSCIENCES↗

2015 Site Environmental Report Fernald Preserve

The Fernald Preserve 2015 Site Environmental Report provides stakeholders with the results from the Fernald, Ohio, Site’s environmental monitoring programs for 2015; a summary of the U.S. Department of Energy’s (DOE’s) activities conducted onsite; and a summary of the Fernald Preserve’s compliance with the various environmental regulations, compliance agreements, and DOE policies that govern site activities. This report has been prepared in accordance with the “Integrated Environmental Monitoring Plan,” which is Attachment D of the Comprehensive Legacy Management and Institutional Controls Plan (LMICP) (DOE 2016). Remediation of the Fernald Preserve has been successfully completed with the exception of the groundwater. During 2015, activities at the Fernald Preserve included: environmental monitoring activities related to direct radiation, groundwater, and surface water; ecological restoration monitoring and maintenance as well as inspections, care, and monitoring of the site and the OSDF to ensure that provisions of the LMICP are fully implemented; OSDF leak detection monitoring and collection, monitoring, and treatment of leachate from the OSDF; extraction, monitoring, and treatment of contaminated groundwater from the Great Miami Aquifer (Operable Unit 5); ongoing operation of the Fernald Preserve Visitors Center, associated outreach, and educational activities; and monitoring as specified in the site’s National Pollutant Discharge Elimination System (NPDES) permit. Environmental monitoring programs were developed to ensure that the remedy remains protective of the environment. The requirements of these programs are described in detail in the LMICP and reported in this Site Environmental Report.

54 ENVIRONMENTAL SCIENCES↗

Error-Bounded Learned Scientific Data Compression with Preservation of Derived Quantities

Scientific applications continue to grow and produce extremely large amounts of data, which require efficient compression algorithms for long-term storage. Compression errors in scientific applications can have a deleterious impact on downstream processing. Thus, it is crucial to preserve all the “known” Quantities of Interest (QoI) during compression. To address this issue, most existing approaches guarantee the reconstruction error of the original data or primary data (PD), but cannot directly control the problem of preserving the QoI. In this work, we propose a physics-informed compression technique that is composed of two parts: (i) reduction of the PD with bounded errors and (ii) preservation of the QoI. In the first step, we combine tensor decompositions, autoencoders, product quantizers, and error-bounded lossy compressors to bound the reconstruction error at high levels of compression. In the second step, we use constraint satisfaction post-processing followed by quantization to preserve the QoI. To illustrate the challenges of reducing the reconstruction errors of the PD and QoI, we focus on simulation data generated by a large-scale fusion code, XGC, which can produce tens of petabytes in a single day. The results show that our approach can achieve a high compression amount while accurately preserving the QoI within scientifically acceptable bounds.

97 MATHEMATICS AND COMPUTING↗