Volume-rendering on a 3D hyperwall: A molecular visualization platform for research, education and outreach
Not provided.
Biochemistry & Molecular Biology↗
SEARCH · Engineering Papers
Results for “Volume Rendering”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
MFA-DVR: direct volume rendering of MFA models
3D volume rendering is widely used to reveal insightful intrinsic patterns of volumetric datasets across many domains. However, the complex structures and varying scales of volumetric data can make efficiently generating high-quality volume rendering results a challenging task. Multivariate functional approximation (MFA) is a new data model that addresses some of the critical challenges: high-order evaluation of both value and derivative anywhere in the spatial domain, compact representation for large-scale volumetric data, and uniform representation of both structured and unstructured data. Here, in this paper, we present MFA-DVR, the first direct volume rendering pipeline utilizing the MFA model, for both structured and unstructured volumetric datasets. We demonstrate improved rendering quality using MFA-DVR on both synthetic and real datasets through a comparative study. We show that MFA-DVR not only generates more faithful volume rendering than using local filters but also performs faster on high-order interpolations on structured and unstructured datasets. MFA-DVR is implemented in the existing volume rendering pipeline of the Visualization Toolkit (VTK) to be accessible by the scientific visualization community.
97 MATHEMATICS AND COMPUTING↗
Progressive CPU Volume Rendering with Sample Accumulation
Here, we present a new method for progressive volume rendering by accumulating object-space samples over successively rendered frames. Existing methods for progressive refinement either use image space methods or average pixels over frames, which can blur features or integrate incorrectly with respect to depth. Our approach stores samples along each ray, accumulates new samples each frame into a buffer, and progressively interleaves and integrates these samples. Though this process requires additional memory, it ensures interactivity and is well suited for CPU architectures with large memory and cache. This approach also extends well to distributed rendering in cluster environments. We implement this technique in Intel’s open source OSPRay CPU ray tracing framework and demonstrate that it is particularly useful for rendering volumetric data with costly sampling functions.
97 MATHEMATICS AND COMPUTING↗
CPU Volume Rendering of Adaptive Mesh Refinement Data
Adaptive Mesh Refinement (AMR) methods are widespread in scientific computing, and visualizing the resulting data with efficient and accurate rendering methods can be vital for enabling interactive data exploration. In this work, we detail a comprehensive solution for directly volume rendering block-structured (Berger-Colella) AMR data in the OSPRay interactive CPU ray tracing framework. In particular, we contribute a general method for representing and traversing AMR data using a kd-tree structure, and four different reconstruction options, one of which in particular (the basis function approach) is novel compared to existing methods. Here, we demonstrate our system on two types of block-structured AMR data and compressed scalar field data, and show how it can be easily used in existing production-ready applications through a prototypical integration in the widely used visualization program ParaView.
97 MATHEMATICS AND COMPUTING↗
Enabling Real-Time Volume Rendering of Functional Magnetic Resonance Imaging on an iOS Device
Powerful non-invasive imaging technologies like computed tomography (CT), ultrasound, and magnetic resonance imaging (MRI) are used daily by medical professionals to diagnose and treat patients. While 2D slice viewers have long been the standard, many tools allowing 3D representations of digital medical data are now available. The newest imaging advancement, functional MRI (fMRI) technology, has changed medical imaging from viewing static to dynamic physiology (4D) over time, particularly to study brain activity. Add this to the rapid adoption of mobile devices for everyday work and the need to visualize fMRI data on tablets or smartphones arises. However, there are few mobile tools available to visualize 3D MRI data, let alone 4D fMRI data. Building volume rendering tools on mobile devices to visualize 3D and 4D medical data is challenging given the limited computational power of the devices. This paper describes research that explored the feasibility of performing real-time 3D and 4D volume raycasting on a tablet device. The prototype application was tested on a 9.7” iPad Pro using two different fMRI datasets of brain activity. The results show that mobile raycasting is able to achieve between 20 and 40 frames per second for traditional 3D datasets, depending on the sampling interval, and up to 9 frames per second for 4D data. While the prototype application did not always achieve true real-time interaction, these results clearly demonstrated that visualizing 3D and 4D digital medical data is feasible with a properly constructed software framework.
62 RADIOLOGY AND NUCLEAR MEDICINE↗
Multi-Material Volume Rendering with a Physically-Based Surface Reflection Model
Not provided.
Computer Science↗
A VR-based volumetric medical image segmentation and visualization system with natural human interaction
Volume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.
42 ENGINEERING↗
ROVER
ROVER Is an application for distributed-memory volume rendering and simulated radiography focused on many-core architectures (e.g., GPU, CPU, and MIC). Volume rendering, also known as volume visualization, is a commonly used scientific visualization algorithm that enables users to visualize an entire scalar field at once by mapping scalar values to colors and transparency. Simulated radiography Is a generalization of the volume rendering algorithm from four color channels (I.e., red, green, blue, and transparency) to an arbitrary number of channels representing material opacities in discrete energy groups, measured In electron volts.
Larsen, Matthew↗
RadVolViz: An Information Display-Inspired Transfer Function Editor for Multivariate Volume Visualization
In volume visualization transfer functions are widely used for mapping voxel properties to color and opacity. Typically, volume density data are scalars which require simple 1D transfer functions to achieve this mapping. If the volume densities are vectors of three channels, one can straightforwardly map each channel to either red, green or blue, which requires a trivial extension of the 1D transfer function editor. Here, we devise a new method that applies to volume data with more than three channels. These types of data often arise in scientific scanning applications, where the data are separated into spectral bands or chemical elements. Our method expands on prior work in which a multivariate information display, RadViz, was fused with a radial color map, in order to visualize multi-band 2D images. In this work, we extend this joint interface to blended volume rendering. The information display allows users to recognize the presence and value distribution of the multivariate voxels and the joint volume rendering display visualizes their spatial distribution. We design a set of operators and lenses that allow users to interactively control the mapping of the multivariate voxels to opacity and color. This enables users to isolate or emphasize volumetric structures with desired multivariate properties. Furthermore, it turns out that our method also enables more insightful displays even for RGB data. We demonstrate our method with three datasets obtained from spectral electron microscopy, high energy X-ray scanning, and atmospheric science.
36 MATERIALS SCIENCE↗
Materializing Inter-Channel Relationships With Multi-Density Woodcock Tracking
Volume rendering techniques for scientific visualization have recently shifted toward Monte Carlo (MC) methods for their flexibility and robustness, but their use in multi-channel visualization remains underexplored. Traditional multi-channel volume rendering often relies on arbitrary, non-physically based color blending functions that hinder interpretation. Here, we introduce multi-density Woodcock tracking, a simple extension of Woodcock tracking that leverages an MC method to produce high-fidelity, physically grounded multi-channel renderings without arbitrary blending. By generalizing Woodcock’s distance tracking, we provide a unified blending modality that also integrates blending functions from prior works. We further implement effects that enhance boundary and feature recognition. By accumulating frames in real-time, our approach delivers high-quality visualizations with perceptual benefits, demonstrated on diverse datasets.
97 MATHEMATICS AND COMPUTING↗
Interactive initialization of 2D/3D rigid registration
Purpose: Registration is one of the key technical components in an image-guided navigation system. A large number of 2D/3D registration algorithms have been previously proposed, but have not been able to transition into clinical practice. The authors identify the primary reason for the lack of adoption with the prerequisite for a sufficiently accurate initial transformation, mean target registration error of about 10 mm or less. In this paper, the authors present two interactive initialization approaches that provide the desired accuracy for x-ray/MR and x-ray/CT registration in the operating room setting. Methods: The authors have developed two interactive registration methods based on visual alignment of a preoperative image, MR, or CT to intraoperative x-rays. In the first approach, the operator uses a gesture based interface to align a volume rendering of the preoperative image to multiple x-rays. The second approach uses a tracked tool available as part of a navigation system. Preoperatively, a virtual replica of the tool is positioned next to the anatomical structures visible in the volumetric data. Intraoperatively, the physical tool is positioned in a similar manner and subsequently used to align a volume rendering to the x-ray images using an augmented reality (AR) approach. Both methods were assessed using three publicly available reference data sets for 2D/3D registration evaluation. Results: In the authors' experiments, the authors show that for x-ray/MR registration, the gesture based method resulted in a mean target registration error (mTRE) of 9.3 ± 5.0 mm with an average interaction time of 146.3 ± 73.0 s, and the AR-based method had mTREs of 7.2 ± 3.2 mm with interaction times of 44 ± 32 s. For x-ray/CT registration, the gesture based method resulted in a mTRE of 7.4 ± 5.0 mm with an average interaction time of 132.1 ± 66.4 s, and the AR-based method had mTREs of 8.3 ± 5.0 mm with interaction times of 58 ± 52 s. Conclusions: Based on the authors' evaluation, the authors conclude that the registration approaches are sufficiently accurate for initializing 2D/3D registration in the OR setting, both when a tracking system is not in use (gesture based approach), and when a tracking system is already in use (AR based approach)
62 RADIOLOGY AND NUCLEAR MEDICINE↗
A Scalable Hybrid Scheme for Ray-Casting of Unstructured Volume Data
We present an algorithm for parallel volume rendering that is a hybrid between classical object order and image order techniques. The algorithm operates on unstructured grids (and structured ones), and thus can deal with block boundaries interleaving in complex ways. It also deals effectively with cases that are prone to load imbalance, i.e., cases where cell sizes differ dramatically, either because of the nature of the input data, or because of the effects of the camera transformation. The algorithm divides work over resources such that each phase of its processing is bounded in the amount of computation it can perform. We demonstrate its efficacy through a series of studies, varying over camera position, data set size, transfer function, image size, and processor count. At its biggest, our experiments scaled up to 8,192 processors and operated on data sets with more than one billion cells. In total, we find that our hybrid algorithm performs well in all cases. This is because our algorithm naturally adapts its computation based on workload, and can operate like either an object order technique or an image order technique in scenarios where those techniques are efficient.
97 MATHEMATICS AND COMPUTING↗
Image Fusion Guidance with Pre-procedural CT with Real-Time Fluoroscopy for Adrenal Venous Sampling
PurposeTo assess the effectiveness of image fusion guidance (IF) with pre-procedural computed tomography (CT) with intraprocedural fluoroscopy for adrenal venous sampling (AVS).Materials and MethodsAVS before and after ACTH stimulation including bilateral segmental sampling of effluent tributaries was performed in 62 patients with IF. A 3D volume rendering image, including adrenal glands and veins extracted from previously obtained contrast-enhanced CT images, was manually registered to the real-time X-ray fluoroscopy. The technical success rates, procedure time, radiation exposure, and volume of contrast medium used were compared with 49 patients who underwent AVS without IF.ResultsNo significant differences in the technical success rates with and without IF were observed (98.4 vs. 91.8% for the right adrenal veins, p = 0.168, and 98.4 vs. 100% for the left adrenal veins, p = 1.000). The procedure time with IF was significantly shorter than that without IF (95.6 ± 18.8 vs. 108.4 ± 20.0 min, p = 0.001). The total dose-area product with IF was significantly lower than that without IF (43.1 ± 30.7 vs. 72.2 ± 45.3 Gy cm{sup 2}, p < 0.001). The contrast medium volume used with IF was significantly lower than that without IF (54.6 ± 21.9 vs. 65.7 ± 27.6 mL, p = 0.020).ConclusionsAlthough the contribution to improving the technical success rates was small in our study, IF can effectively reduce procedure time, radiation exposure, and volume of contrast medium during AVS.
62 RADIOLOGY AND NUCLEAR MEDICINE↗
The application of cinematic rendering to CT evaluation of upper tract urothelial tumors: principles and practice
Upper tract urothelial carcinoma (UTUC) is a relatively uncommon but aggressive genitourinary malignancy for which multi-phase contrast-enhanced computed tomography (CT) plays an important role in evaluation and staging. 3D imaging with maximum intensity projection (MIP) and volume-rendered (VR) images has been described as a useful means of evaluating UTUC. In this study, we describe the technique of a novel 3D methodology known as cinematic rendering (CR) and provide clinical examples of UTUC visualized with CR. CR utilizes a complex universal lighting model in order to create photorealistic images with improved detail and depth in comparison to MIP or VR images. In the case of UTUC, CR can be used in different contrast phases to show abnormally thickened and enhancing urothelium or filling defects in the renal collecting system or ureters in the excretory phase. CR images can also be manipulated in order to generate translucent views of the upper urinary tract in order to add conspicuity to intraluminal findings.
62 RADIOLOGY AND NUCLEAR MEDICINE↗
Volumetric Rendering on Wavelet-Based Adaptive Grid
Numerical modeling of physical phenomena frequently involves processes across a wide range of spatial and temporal scales. In the last two decades, the advancements in wavelet-based numerical methodologies to solve partial differential equations, combined with the unique properties of wavelet analysis to resolve localized structures of the solution on dynamically adaptive computational meshes, make it feasible to perform large-scale numerical simulations of a variety of physical systems on a dynamically adaptive computational mesh that changes both in space and time. Volumetric visualization of the solution is an essential part of scientific computing, yet the existing volumetric visualization techniques do not take full advantage of multi-resolution wavelet analysis and are not fully tailored for visualization of a compressed solution on the wavelet-based adaptive computational mesh. Our objective is to explore the alternatives for the visualization of time-dependent data on space-time varying adaptive mesh using volume rendering while capitalizing on the available sparse data representation. Two alternative formulations are explored. The first one is based on volumetric ray casting of multi-scale datasets in wavelet space. Rather than working with the wavelets at the finest possible resolution, a partial inverse wavelet transform is performed as a preprocessing step to obtain scaling functions on a uniform grid at a user-prescribed resolution. As a result, a solution in physical space is represented by a superposition of scaling functions on a coarse regular grid and wavelets on an adaptive mesh. An efficient and accurate ray casting algorithm is based just on these coarse scaling functions. Additional details are added during the ray tracing by taking an appropriate number of wavelets into account based on support overlap with the interpolation point, wavelet coefficient magnitude, and other characteristics, such as opacity accumulation (front to back ordering) and deviation from frontal viewing direction. The second approach is based on complementing of wavelet-based adaptive mesh to the traditional Adaptive Mesh Refinement (AMR) mesh. Both algorithms are illustrated and compared to the existing volume visualization software for Rayleigh-Benard thermal convection and electron density data sets in terms of rendering time and visual quality for different data compression of both wavelet-based and AMR adaptive meshes.
Vezolainen, Alexei V.↗
Image Fusion of Preprocedural CTA with Real-time Fluoroscopy to Guide Proper Hepatic Artery Catheterization During Transarterial Chemoembolization of Hepatocellular Carcinoma: A Feasibility Study
To assess feasibility of proper hepatic artery catheterization using a 3D model obtained from preprocedural computed tomographic angiography (CTA), fused with real-time fluoroscopy, during transarterial chemoembolization of hepatocellular carcinoma. Twenty consecutive cirrhotic patients with hepatocellular carcinoma undergoing transarterial chemoembolization were prospectively enrolled onto the study. The early arterial phase axial images of the preprocedural CTA were postprocessed on an independent workstation connected to the angiographic system (Innova 4100; GE Healthcare, Milwaukee, WI), obtaining a 3D volume rendering image (VR) that included abdominal aorta, splanchnic arteries, and first and second lumbar vertebrae. The VR image was manually registered to the real-time X-ray fluoroscopy, with the lumbar spine used as the reference. The VR image was then used as guidance to selectively catheterize the proper hepatic artery. The procedure was considered successful when performed with no need for intraarterial contrast injections or angiographic acquisitions. The procedure was successful in 19 (95 %) of 20 patients. In one patient, celiac trunk angiography was required for the presence of a significant ostial stenosis that was underestimated at computed tomography. Time for image reconstruction and registration was <10 min in all cases. The use of preprocedural CTA model with fluoroscopy enables confident and direct catheterization of the proper hepatic artery with no need for preliminary celiac trunk angiography, thus reducing radiation exposure and contrast media administration.
62 RADIOLOGY AND NUCLEAR MEDICINE↗