Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Digitization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

New Architecture to Support Integration and Processing of Seismic Data from Heterogeneous Sources

The Geophysical Monitoring Program (GMP) at Lawrence Livermore National Lab (LLNL) maintains a database and supporting infrastructure for geophysical data used in support of the Nuclear Detonation Detection mission. This database includes data from multiple sources, many of which do not distribute data to the public or for which there is no automated means of access. For example, Figure 1 shows (left) the distribution of waveform data in our database by source. The Incorporated Research Institutions for Seismology Data Management Center (IRISDMC) is our major source of waveform data and those data may be retrieved at will using the Federated Digital Seismograph Networks FDSN web Application Programming Interface (API). However, the next 6 most important sources of waveform data have no or only limited automated access to waveforms. As Figure 1 (right) shows, it is very common for waveform records associate with an event in our database to come from two or more sources, and in some cases data come from 10 sources. This diversity of data sources drives our need for efficient and correct integration of metadata, parametric data, and waveform data.

58 GEOSCIENCES↗

Multilevel Cybersecurity for Photovoltaic Systems

The motivation behind this project is to protect critical infrastructure in electric power generation pertaining to solar photovoltaic (PV) systems. This growing renewable energy resource is becoming a more vital part of the nation’s energy portfolio, particularly since it has achieved grid-parity to existing generation methods in terms of cost. It is thus vital that steps be taken to ensure the cybersecurity of these assets. The project goal was to devise a multilevel cybersecurity solution to address PV security gaps at the inverter and system levels, and field test the solution under the supervision and review of a US-based solar inverter manufacturer and PV installer/operator. A two-level cyberattack defense approach was formulated whereby the first level, the solar inverter level, hardens individual devices and achieves a deeply cyber-secure inverter. The inverter level security involves a multi-layer defense-in-depth approach for securing the inverter while also providing data for the system level algorithms. The second level, the system level, addresses intrusion detection and restoration involving an ensemble of inverters and relevant systems.

14 SOLAR ENERGY↗

Results from an Aeromagnetic Survey to Detect Steel-Cased Wells at a Marcellus Shale Well Site in Washington County, Pennsylvania

Pennsylvania has a 150-year history of oil and gas production—the longest of any state—and this enduring activity has resulted in the drilling of more than 300,000 recorded wells. However, unknown wells likely exist because innumerable wells were drilled during Pennsylvania’s intense early oil and gas history when incomplete records were kept of well locations. There is concern that early wells are likely to be ineffectively sealed because there were no laws that required plugging when the wells were abandoned. Today, many undocumented and unplugged wells are thought to be in areas of emerging shale gas and shale oil development where open wellbores can provide a pathway for undesired upward migration of fluids and gas from hydraulically fractured reservoirs. Due to this concern, Pennsylvania regulators have asked operators to locate orphaned and abandoned wells within a 1,000-ft buffer of proposed new wells. The objective of this report is to demonstrate that high-resolution aeromagnetic surveys, historic air photos, and Light Detection and Ranging (LiDAR) imagery can be rapid and effective methods to reconnoiter large, forested areas of moderate terrain for the presence of abandoned wells. These well-finding methods were evaluated at a proposed Marcellus Shale gas drilling site in Washington County, Pennsylvania, where the methods collectively located 18 confirmed wells: 15 wells were identified from aeromagnetic surveys, two wells were identified from inspection of historical air photos, and one well was identified by evaluation of state-wide LiDAR imagery. Only six wells were previously known, and their locations, as recorded in Pennsylvania’s statewide oil and gas wells database (PA/IRIS/WIS), were often too inaccurate for the wells to be found in the dense underbrush. Twelve wells identified in this study were abandoned, unmarked, and undocumented. Aeromagnetic surveys locate wells by detecting the unique magnetic signature of vertical, steel well casing, which is depicted on magnetic maps as a “bull’s eye” type anomaly that is centered directly over the well. However, when wells were drilled and found to be sub-economic, their casing was sometimes pulled and salvaged for reuse. Such wellbores provide no magnetic response and go undetected if all casing was removed. Oftentimes attempts to retrieve well casing were not 100% successful. For example, historical records for one well in the study area indicate that the well was completed in 1902 as a dry hole and that, to the extent possible, the casing was pulled for reuse. However, a section of 10-in. diameter steel casing was not recovered and remains at an unknown depth in the wellbore. This well was easily detected by the aeromagnetic survey although only deep casing remained in the well. To mitigate for the likelihood that wellbores exist where most or all casing has been removed, this study augmented aeromagnetic data with historic air photos and digital terrain models generated from LiDAR datasets—both databases are publicly available at no cost for areas within Pennsylvania. These complementary methods located three wells where the aeromagnetic anomaly, although present, was subtle and overlooked. Together, these methods determined accurate locations for six known wells within the study area and located 12 previously unknown wells. Although it is not certain that these methods successfully located all wells in the study area, the application of these methods does represent a significant improvement over relying on existing databases for well locations. For the Appendix to the report, see: https://www.netl.doe.gov/energy-analysis/details?id=b46c417a-7c9e-4d25-b810-e6248b0217f4</p>

04 OIL SHALES AND TAR SANDS↗

Large-scale homogeneity in the distribution of quasars in the Hercules-Corona Borealis Great Wall region

In light of recent debates on the existence of a gigaparsec-scale structure traced by gamma-ray bursts, namely the Hercules-Corona Borealis Great Wall (HCBGW), we revisit large-scale homogeneity in the spatial distribution of quasars. Our volume-limited sample of quasars in the redshift range 1:6 < z ≤ 2:1, which is constructed from the data release 7 of the Sloan Digital Sky Survey quasar catalogue, covers about half of the suspected HCBGW region. We analyze the sample in two complementary ways: fractal analysis of determining the average scale of homogeneity and friends- of-friends analysis of identifying specific large-scale structures. The quasar distribution on average reaches homogeneity at rh = 136 ± 38h-1 Mpc and the richness and comoving size frequencies of large (> ~ 150h-1 Mpc) quasar groups are consistent with the prediction of homogeneous distribution. These results put constraints on the spatial extent of the HCBGW but do not contradict its existence since our quasar sample does not cover the entire HCBGW region.

79 ASTRONOMY AND ASTROPHYSICS↗

Towards Net Zero: Modeling Approach to the Right-Sized Facilities

As the concentration of greenhouse gases (GHGs) in the atmosphere increases, the concerns about carbon emissions are growing. Several net-zero initiatives are taking place around the globe to achieve a balance between the GHGs put into the atmosphere and those taken out. While most efforts present a sectorized approach, this paper describes the importance of integrating information across different sectors for effective modeling of carbon emissions and holistic reduction opportunity analysis. Using the Idaho National Laboratory (INL) campus as a test case, this work provides a web-based tool for INL stakeholders to use when engaging in strategic planning to achieve carbon emissions reduction. This net-zero engineering support tool (NEST) uses historical data as foundational information for applying the modeling framework. Prediction of CO 2 emissions throughout project completion integrates various approaches and schedules aimed at energy conservation, fleet decarbonization, and other GHG reduction activities. Using NEST, stakeholders can visualize carbon emissions, electricity consumption, and costs for decision making when planning the pathway for reaching carbon net zero. The INL’s initiative to transition into an EV fleet was used to demonstrate the developed framework and the advantages of using NEST. It was shown that electrifying different fossil-fueled campus vehicles before 2030 with aggressive replacement schedules require high annual capital expenditure (CAPEX), which may not be available. The tool allows decision makers to test different replacement schedules and prioritize those that yield CAPEX below a certain threshold while meeting target milestones. While the demonstration focused on vehicle electrification, the developed framework lays the foundation for further quantitative analysis of other GHG reduction activities.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

First M87 Event Horizon Telescope Results. II. Array and Instrumentation

The Event Horizon Telescope(EHT)is a very long baseline interferometry (VLBI) array that comprises millimeter- and submillimeter-wavelength telescopes separated by distances comparable to the diameter of the Earth. At a nominal operating wavelength of∼1.3 mm, EHT angular resolution(λ/D)is∼25μas, which is sufficient to resolve nearby supermassive black hole candidates on spatial and temporal scales that correspond to their event horizons. With this capability, the EHT scientific goals are to probe general relativistic effects in the strong-field regime and to study accretion and relativistic jet formation near the black hole boundary. In this Letterwe describe the system design of the EHT, detail the technology and instrumentation that enable observations, and provide measures of its performance. Meeting the EHT science objectives has required several key developments that have facilitated the robust extension of the VLBI technique to EHT observing wavelengths and the production of instrumentation that can be deployed on a heterogeneous array of existing telescopes and facilities. To meet sensitivity requirements, high-bandwidth digital systems were developed that process data at rates of 64 gigabit s−1, exceeding those of currently operating cm-wavelength VLBI arrays by more than an order of magnitude. Associated improvements include the development of phasing systems at array facilities, new receiver installation at several sites, and the deployment of hydrogen maser frequency standards to ensure coherent data capture across the array. These efforts led to the coordination and execution of the first Global EHT observations in2017 April, and to event-horizon-scale imaging of the supermassive black hole candidate in M87.

79 ASTRONOMY AND ASTROPHYSICS↗

A Review of Sociotechnical Approaches for Nuclear Power Plant Modernization

The current United States nuclear power plant fleet is in need of transforming the way work is performed to remain competitive with other electricity-generating sources. The use of new digital technologies can be applied to significantly reduce operating and maintenance costs. Recent research by the United States Department of Energy Light Water Reactor Sustainability Program has identified new opportunities to leverage advanced digital technologies to transform the way work is performed at existing plants. However, to ensure that the capabilities of people and advanced digital technologies are jointly optimized, a sociotechnical approach should be considered. This work explores recently introduced sociotechnical approaches to address the function allocation and data visualization considerations in the integration of new digital technologies to ensure safety, reliability, and maximizing the capabilities of proposed technological solutions that ensure the economic viability of the existing United States nuclear power plant fleet.

99 GENERAL AND MISCELLANEOUS↗

High-Definition Optical Velocimetry: A New Diagnostic Paradigm for Nuclear Security

This slide-show describes work done to address the challenge of high-definition optical velocimetry with hundred(s) of high-fidelity velocity vs. time measurements. After a review of the historical context and a general technical description of how optical velocimetry, particularly photonic Doppler velocimetry, works, the innovation of multiplexed photonic Doppler velocimetry (MPDV) is described as implemented with commercially available telecom products and dense wavelength division multiplexing (DWDM). High amplification of small signals allows for laser-safe operations. The authors have evaluated and leveraged telecom components– optical amplifiers, wavelength multiplexers, and seed lasers–to provide an economical, compact and rugged approach to system architecture. Fourier transform data analysis is seen to be robust and capable of discriminating simultaneous data traces recorded onto a single digitizer channel. The authors successfully fielded demonstration MPDV system on shock driven experiments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Design, Implementation, and Evaluation of a Hybrid DS/FFH Spread-Spectrum Radio Transceiver

In recent years there has been great interest in using hybrid spread-spectrum (HSS) techniques for commercial applications, particularly in the Smart Grid, in addition to their inherent uses in military communications. This is because HSS can accommodate high data rates with high link integrity, even in the presence of significant multipath effects and interfering signals. A highly useful form of this transmission technique for many types of command, control, and sensing applications is the specific code-related combination of standard direct-sequence modulation with "fast" frequency-hopping, denoted hybrid DS/FFH, wherein multiple frequency hops occur within a single data-bit time. In this paper, we present the efforts carried out at Oak Ridge National Laboratory toward exploring the design, implementation, and evaluation of a hybrid DS/FFH spread-spectrum radio transceiver using a single Field Programmable Gate Array (FPGA). The FPGA allows the various subsystems to quickly communicate with each other and thereby maintain tight synchronization. We also investigate various hopping sequences against robustness to interference and jamming. Experimental results are presented that show the receiver sensitivity, radio data-rate/bit-error evaluations, and jamming and interference rejection capabilities of the implemented hybrid DS/FFH spread-spectrum system under widely varying design parameters.

data rate↗

Feasibility Analysis of Taxi Fleet Electrification

Ride-hailing activity is rapidly increasing, largely due to the growth of transportation network companies such as Uber and Lyft. However, traditional taxi companies continue to represent an important mobility option for travelers. Columbus Yellow Cab, a taxi company in Columbus, Ohio, offers traditional line-of-sight hailing as well as digital hailing through a mobile app. Data from Columbus Yellow Cab were provided to the National Renewable Energy Laboratory to analyze the potential for taxi electrification. Columbus Yellow Cab data contained information describing both global positioning system trajectories and taxi meter information. The data spanned a period of 13 months, containing approximately 70 million global system positioning system points, 840 thousand trips, and 170 unique vehicles. A variety of scenarios were evaluated using Columbus Yellow Cab data and the Electric Vehicle Infrastructure Projection Tool (EVI-Pro) to understand challenges and opportunities associated with operating an electrified taxi fleet. Two main factors, access to home charging and vehicle specifications, are shown to be major variables affecting successful electric fleet operation. The analysis indicates that 95.7% of taxi travel days can be successfully completed by a 250-mile-range electric vehicle assuming access to overnight and public charging infrastructure. However, when no overnight access is available to fleet vehicles, only 39.9% of taxi travel days are possible with 250-mile range electric vehicles. An additional scenario, reducing the vehicle range from 250 miles to 100 miles (while controlling for infrastructure access and permitting overnight charging) resulted in only 34.4% of taxi travel days being completed.

30 DIRECT ENERGY CONVERSION↗

Experiments and numerical modeling of surrogate droplet combustion for a 93 octane gasoline calibration fuel

Gasoline is the world’s most prolific liquid transportation fuel for ground transportation vehicles. Yet, a fundamental understanding of its burning characteristics is still lacking. Complicating this matter is the highly multicomponent nature of gasoline (comprised of hundreds of chemical species) and the seasonable variability of its composition due to variations in the crude oil feedstocks used in refining. The need to bring order to this complex problem has led to development of calibration fuels (Tier II in presented study) which on average will provide repeatable metrics that replicate performance of refined gasoline for various engine designs. This study presents results of experiments using the configuration of an isolated droplet to study the combustion dynamics of calibration fuel and three different surrogates (S4, S5, S6) for the calibration fuel. Droplet burning is under microgravity conditions, where gas transport is determined entirely by fuel evaporation in order to promote spherical symmetry in the burning process. The initial droplet diameters ranged between 0.55 mm and 0.60 mm. The droplets were spark-ignited and their burning histories were recorded by digital video cameras to obtain quantitative data. For each fuel, the evolutions of droplet, flame, and soot-shell diameters were measured to calculate the burn rates, flame-droplet diameter ratios (FSR) and soot-droplet diameter ratios. Additionally, a detailed numerical modeling is presented. This simulation includes multicomponent phase equilibrium, unsteady gas and liquid transport, radiative heat transfer, internal liquid diffusion and detailed combustion chemistry of different fuels during their burning process. Experiment results show that the calibration fuel and surrogates have a close burn rates and FSR, and S5 presents a relatively similar results with calibration fuel. Predictions from the numerical simulation using the surrogate are compared with experiment measurements, which showed a good agreement with the experiment results, including the droplet burning rate and FSR.

Guo, Songtao↗

Digital Rock Studies of Tight Porous Media

This technical report summarizes some recently developed approaches to studies of rock properties at a pore scale. Digital rock approach is complementary to laboratory and field studies. It can be especially helpful in situations where experimental data are uncertain, or are difficult or impossible to obtain. Digitized binary images of the pore geometries of natural rocks obtained by different imaging techniques are the input data. Computer-generated models of natural rocks can be used instead of images in a case where microtomography data are unavailable, or the resolution of the tools is insufficient to adequately characterize the features of interest. Simulations of creeping viscous flow in pores produce estimates of Darcy permeability. Maximal Inscribed Spheres calculations estimate two-phase fluid distribution in capillary equilibrium. A combination of both produce relative permeability curves. Computer-generated rock models were employed to study two-phase properties of fractured rocks, or tight sands with slit-like pores, too narrow to be characterized with micro-tomography. Various scenarios can simulate different fluid displacement mechanisms, from piston-like drainage to liquid dropout at the dew point. A finite differences discretization of Stokes equation is developed to simulate flow in the pore space of natural rocks. The numerical schemes are capable to handle both no-slip and slippage flows. An upscaling procedure estimates the permeability by subsampling a large data set. Capillary equilibrium and capillary pressure curves are efficiently estimated with the method of maximal inscribed spheres both an arbitrary contact angle. The algorithms can handle gigobytes of data on a desktop workstation. Customized QuickHull algorithms model natural rocks. Capillary pressure curves evaluated from computer-generated images mimic those obtained for microtomography data.

54 ENVIRONMENTAL SCIENCES↗

Three-dimensional anisotropic adaptive filtering of projection data for noise reduction in cone beam CT

Purpose: The combination of quickly rotating C-arm gantry with digital flat panel has enabled the acquisition of three-dimensional data (3D) in the interventional suite. However, image quality is still somewhat limited since the hardware has not been optimized for CT imaging. Adaptive anisotropic filtering has the ability to improve image quality by reducing the noise level and therewith the radiation dose without introducing noticeable blurring. By applying the filtering prior to 3D reconstruction, noise-induced streak artifacts are reduced as compared to processing in the image domain. Methods: 3D anisotropic adaptive filtering was used to process an ensemble of 2D x-ray views acquired along a circular trajectory around an object. After arranging the input data into a 3D space (2D projections + angle), the orientation of structures was estimated using a set of differently oriented filters. The resulting tensor representation of local orientation was utilized to control the anisotropic filtering. Low-pass filtering is applied only along structures to maintain high spatial frequency components perpendicular to these. The evaluation of the proposed algorithm includes numerical simulations, phantom experiments, and in-vivo data which were acquired using an AXIOM Artis dTA C-arm system (Siemens AG, Healthcare Sector, Forchheim, Germany). Spatial resolution and noise levels were compared with and without adaptive filtering. A human observer study was carried out to evaluate low-contrast detectability. Results: The adaptive anisotropic filtering algorithm was found to significantly improve low-contrast detectability by reducing the noise level by half (reduction of the standard deviation in certain areas from 74 to 30 HU). Virtually no degradation of high contrast spatial resolution was observed in the modulation transfer function (MTF) analysis. Although the algorithm is computationally intensive, hardware acceleration using Nvidia's CUDA Interface provided an 8.9-fold speed-up of the processing (from 1336 to 150 s). Conclusions: Adaptive anisotropic filtering has the potential to substantially improve image quality and/or reduce the radiation dose required for obtaining 3D image data using cone beam CT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

The FRB-searching Pipeline of the Tianlai Cylinder Pathfinder Array

This paper presents the design, calibration, and survey strategy of the Fast Radio Burst (FRB) digital backend and its real-time data processing pipeline employed in the Tianlai Cylinder Pathfinder Array. The array, consisting of three parallel cylindrical reflectors and equipped with 96 dual-polarization feeds, is a radio interferometer array designed for conducting drift scans of the northern celestial semi-sphere. The FRB digital backend enables the formation of 96 digital beams, effectively covering an area of approximately 40 square degrees with the 3 dB beam. Our pipeline demonstrates the capability to conduct an automatic search of FRBs, detecting at quasi-real-time and classifying FRB candidates automatically. The current FRB searching pipeline has an overall recall rate of 88%. During the commissioning phase, we successfully detected signals emitted by four well-known pulsars: PSR B0329+54, B2021+51, B0823+26, and B2020+28. We report the first discovery of an FRB by our array, designated as FRB 20220414A. We also investigate the optimal arrangement for the digitally formed beams to achieve maximum detection rate by numerical simulation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

1.2.4.404 - Data-Driven Approach for Hydropower Plant Controller Prototyping Using Remote Hardware in the Loop (DR-HIL)

Real-time prototyping of hydropower plant controls is important for reducing the cost and the risk of field deployment. This project will 1) collect design and operational data from actual hydro plants and 2) use a physics-informed machine learning approach for real-time emulation of hydropower plants, including hydro turbine and hydrodynamics. The data-driven models will be interfaced with digital real-time simulation at NREL’s Flatirons campus for hardware-in-the-loop (HIL) testing of the governor hardware device or controller-HIL (CHIL). The proposed approach will also establish the connectivity based remote CHIL testing capability using real-time data streams from an actual hydro plant. This integrated hydro-plant emulation with CHIL will be used to prototype hydro-governor controls and eventually provide an opportunity to test hydropower integrated with various technologies (e.g. conventional and renewable generation, energy conversion, etc.) as HIL.

controls prototyping↗

Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+)

Abstract. Geoscientific models and measurements generate false precision (scientifically meaningless data bits) that wastes storage space. False precision can mislead (by implying noise is signal) and be scientifically pointless, especially for measurements. By contrast, lossy compression can be both economical (save space) and heuristic (clarify data limitations) without compromising the scientific integrity of data. Data quantization can thus be appropriate regardless of whether space limitations are a concern. We introduce, implement, and characterize a new lossy compression scheme suitable for IEEE floating-point data. Our new Bit Grooming algorithm alternately shaves (to zero) and sets (to one) the least significant bits of consecutive values to preserve a desired precision. This is a symmetric, two-sided variant of an algorithm sometimes called Bit Shaving that quantizes values solely by zeroing bits. Our variation eliminates the artificial low bias produced by always zeroing bits, and makes Bit Grooming more suitable for arrays and multi-dimensional fields whose mean statistics are important. Bit Grooming relies on standard lossless compression to achieve the actual reduction in storage space, so we tested Bit Grooming by applying the DEFLATE compression algorithm to bit-groomed and full-precision climate data stored in netCDF3, netCDF4, HDF4, and HDF5 formats. Bit Grooming reduces the storage space required by initially uncompressed and compressed climate data by 25–80 and 5–65 %, respectively, for single-precision values (the most common case for climate data) quantized to retain 1–5 decimal digits of precision. The potential reduction is greater for double-precision datasets. When used aggressively (i.e., preserving only 1–2 digits), Bit Grooming produces storage reductions comparable to other quantization techniques such as Linear Packing. Unlike Linear Packing, whose guaranteed precision rapidly degrades within the relatively narrow dynamic range of values that it can compress, Bit Grooming guarantees the specified precision throughout the full floating-point range. Data quantization by Bit Grooming is irreversible (i.e., lossy) yet transparent, meaning that no extra processing is required by data users/readers. Hence Bit Grooming can easily reduce data storage volume without sacrificing scientific precision or imposing extra burdens on users.

58 GEOSCIENCES↗

WISE × SuperCOSMOS photometric Redshift catalog: 20 million galaxies over 3π steradians

We cross-match the two currently largest all-sky photometric catalogs—mid-infrared Wide-field Infrared Survey Explorer and SuperCOSMOS scans of UKST/POSS-II photographic plates—to obtain a new galaxy sample that covers 3π steradians. In order to characterize and purify the extragalactic data set, we use external GAMA and Sloan Digital Sky Survey spectroscopic information to define quasar and star loci in multicolor space, aiding the removal of contamination from our extended source catalog. After appropriate data cleaning, we obtain a deep wide-angle galaxy sample that is approximately 95% pure and 90% complete at high Galactic latitudes. The catalog contains close to 20 million galaxies over almost 70% of the sky, outside the Zone of Avoidance and other confused regions, with a mean surface density of more than 650 sources per square degree. Using multiwavelength information from two optical and two mid-IR photometric bands, we derive photometric redshifts for all the galaxies in the catalog, using the ANNz framework trained on the final GAMA-II spectroscopic data. Our sample has a median redshift of z{sub med}=0.2, with a broad dN/dz reaching up to z > 0.4. The photometric redshifts have a mean bias of |δz|∼10{sup −3}, a normalized scatter of σ {sub z} = 0.033, and less than 3% outliers beyond 3σ {sub z}. Comparison with external data sets shows no significant variation of photo-z quality with sky position. Together with the overall statistics, we also provide a more detailed analysis of photometric redshift accuracy as a function of magnitudes and colors. The final catalog is appropriate for “all-sky” three-dimensional (3D) cosmology to unprecedented depths, in particular through cross-correlations with other large-area surveys. It should also be useful for source preselection and identification in forthcoming surveys, such as TAIPAN or WALLABY.

79 ASTRONOMY AND ASTROPHYSICS↗

Compression-based integral curve data reuse framework for flow visualization

Currently, by default, integral curves are repeatedly re-computed in different flow visualization applications, such as FTLE field computation, source-destination queries, etc., leading to unnecessary resource cost. We present a compression-based data reuse framework for integral curves, to greatly reduce their retrieval cost, especially in a resource-limited environment. In our design, a hierarchical and hybrid compression scheme is proposed to balance three objectives, including high compression ratio, controllable error, and low decompression cost. Specifically, we use and combine digitized curve sparse representation, floating-point data compression, and octree space partitioning to adaptively achieve the objectives. Results have shown that our data reuse framework could acquire tens of times acceleration in the resource-limited environment compared to on-the-fly particle tracing, and keep controllable information loss. Moreover, our method could provide fast integral curve retrieval for more complex data, such as unstructured mesh data.

97 MATHEMATICS AND COMPUTING↗