Computational and Mathematical Methods in Medicine

Volume 2013 (2013), Article ID 874517, 5 pages

http://dx.doi.org/10.1155/2013/874517

Research Article

Plane-Based Sampling for Ray Casting Algorithm in Sequential Medical Images

Lili Lin,¹ Shengyong Chen,¹ Yan Shao,² and Zichun Gu²

¹School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China

²Department of Plastic and Reconstructive Surgery, Sir Run Run Shaw Hospital, Medical College, Zhejiang University, Hangzhou 310016, China

Received 9 December 2012; Accepted 28 December 2012

Academic Editor: Carlo Cattani

Copyright © 2013 Lili Lin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper proposes a plane-based sampling method to improve the traditional Ray Casting Algorithm (RCA) for the fast reconstruction of a three-dimensional biomedical model from sequential images. In the novel method, the optical properties of all sampling points depend on the intersection points when a ray travels through an equidistant parallel plan cluster of the volume dataset. The results show that the method improves the rendering speed at over three times compared with the conventional algorithm and the image quality is well guaranteed.

1. Introduction

Modeling three-dimensional (3D) volume of biomedical tissues from 2D sequential images is an important technique to highly improve the diagnostic accuracy [1]. Volume rendering refers to the process that maps the 3D discrete digital data into image pixel values [2]. It can be classified into two categories: one is direct volume rendering which generates images by compositing pixel values along rays cast into a 3D image, and the other one is indirect volume rendering which visualizes geometry element graphics extracted from the volume data [3]. The importance of volume rendering is resampling and synthesizing image [4]. Ray casting, splatting, and shear-warp are the three popular volume rendering algorithms now [5].

Ray Casting Algorithm (RCA) is a direct volume rendering algorithm. The traditional RCA is widely used for it can precisely visualize various medical images with details of boundary and internal information from sequential images, while real-time rendering with traditional RCA is still an obstacle due to its huge computation.

In recent years, numerous techniques have been proposed to accelerate the rendering speed. In general, there are three primary aspects, including hardware-based, parallel, and software-based acceleration algorithms. Liu et al. [6] proposed a method combined that Graphics Processing Unit (GPU) and octree encoding and accelerated RCA at a rate of 85 times. Wei and Feng [7] presented a GPU-based real-time ray casting method for algebraic B-spline surfaces via iterative root-finding algorithms. Zhang et al. [8] accelerated RCA on Compute Unified Device Architecture (CUDA), which can perform more samplings within a ray segment using cubic B-spline.

However, both hardware-based and parallel techniques are inseparable from the development of computer hardware. By comparison, software-based algorithms can be quickly transplanted among different machines. What is more, they can show flexibility of the procedure and reflect the thoughts of researchers. Yang et al. [9] sampled points based on all intersection points at which the ray transacts with the voxel. All intersections in a voxel depend on four vertexes on one face. However, the condition whether two intersection points were on adjacent or opposite surface in a voxel was neglected. Ling and Qian [10] used a bounding volume method to avoid casting the viewing rays that do not intersect with the volume. Since such situation can be judged quickly by comparing the world coordinates of sampling point with the volume dataset, it did not obviously speed up the rendering process. Recently, Qian et al. [11] replaced the sampling points with intersection points when rays travel through three groups of parallel planes along three orthometric axes to reduce the rendering time. However, it cannot guarantee the image density when the distance between adjacent parallel planes far surpasses the sampling interval.

This paper proposes an improved RCA to speed the rendering process. The main idea is, when the ray travels through one group of equidistant parallel planes of the volume, intersection points are obtained. Then the properties of sampling points between adjacent intersection points can be calculated by the formula of definite proportion and separated points. By this method, a small number of intersection points are considered; meanwhile the method does not sacrifice the sampling density.

2. Ray Casting Algorithm

2.1. Ray Casting Algorithm Overview

The traditional RCA involves two steps: (1) assign optical properties such as color and opacity to all 3D discrete vertexes according to their gray value, and (2) apply a sampling and composing process. For each output image pixel in sequence, do the following.

(i)Cast the ray through the volume from back to front.(ii)Sample the color and opacity at each regular sampling point along the ray.(iii)Set the color of the current output pixel according to

The rendering time is mainly comprised of four parts in the above-mentioned rendering process [11]. They are converting gray value into optical property (about 30%), computing position of sampling points (about 3%), sampling optical properties (about 39%), and compositing properties into output pixel color (about 6%). The time proportion of sampling is the highest. Moreover, the time ratio of four parts is not constant. The greater the sampling data is, the larger the proportion of sampling time is. Therefore, sampling has a direct impact on speed of RCA.

2.2. Traditional Sampling Method

Traditionally, the optical property of each sampling point depends on eight vertexes of its voxel by trilinear interpolation [12, 13]. In detail, there are four steps for the sampling one point. First, locate its voxel and convert the world coordinates of sampling point into voxel’s local coordinates. The following three steps are processes of linear interpolations along three different axes in order. The interpolation diagram of Ray Casting Algorithm is shown in Figure 1.

Figure 1: Interpolation for ray casting.

For example, to sample point in white circle (Figure 1), first obtain the voxel and local coordinates of , which are expressed in (2). Then the optical property of four points () on the plane through is deduced according to eight vertexes () along z-axis. The next property of two points () forming the line segment through is computed along -axis. At last is obtained along -axis by definite proportional division point formula.

In Figure 1, assume the pixel spacing along , , axes is , , and , respectively, with :

where operator [] represents taking the floor integral.

The property of can be calculated by and , which are obtained by , and . The relationship between them is shown in

According to the above equations, 17 additions and 16 multiplications are executed for sampling each point such as (see Figure 1), including 3 additions and 9 multiplications to locate the voxel and get the local coordinates. In Figure 1, there are 6 sampling points in two voxels, 102 additions, and 96 multiplications performed. To simplify the calculation of sampling process, a new RCA based on plane clusters sampling is proposed.

2.3. Proposed Plan-Based Sampling Method

The basic idea of the plan-based sampling method is to acquire all sampling points based on intersection points when ray travels through a group of parallel planes in the volume data field.

The sampling process, specifically, consists of three steps. First, intersections and the corresponding plane are obtained based on some necessary initial conditions. Then the optical property of all the intersection points is obtained by linear interpolation according to vertexes on plane clusters. The optical property of sampling points between intersection points along the ray is computed by definite proportion and separated point formula.

Assuming that the direction vector of ray is and the extent of gridding volume data is , with the spacing along , , axes, respectively, the three plane clusters are as follows:

Parallel plane clusters along axis are selected. Let the origin point of ray be . The ray intersects with plane at entry point and belongs to the voxel . The coordinates of and voxel are deduced next. The derivation is shown as follows. Since

where means the distance from to along ray, the value of can be obtained from

Therefore,

and of can be expressed as follows:

Considering that belongs to voxel , then and are expressed as follows:

Therefore, when is given, , and can be obtained through the above equations.

From the mathematical derivation, when original position, direction vector, and the extent of volume data are given, all the intersections and associated voxels can be quickly obtained.

In Figure 1, the property of entry point can be computed by the property () of three vertexes on voxel , that is,

In the same way, the property of exit point can be obtained. At last the property is expressed as follows:

In addition, when one component of the direction vector is zero, a plane cluster along another axis can be chosen. If two components are zero, the plane clusters along the third axis are taken into account.

2.4. Comparison of Two Sampling Methods

In the new RCA sampling process, only intersection points on a plane cluster along one axis need to be considered without converting coordinates. While in the conventional sampling process, the world coordinates of each sampling point are converted into voxel’s local coordinates and computed by trilinear interpolation [14, 15].

As is shown in Figure 1, there are 6 sampling points between and . 15 additions and 19 multiplications are executed to sample and , and 24 additions and 12 multiplications are run to sample six points based on and . Totally, 39 additions and 31 multiplications are taken compared with 102 additions and 96 multiplications with trilinear interpolation. Furthermore, not all vertexes are referred because some vertexes (such as in Figure 1) are not used as reference by the new method. Thus, in theory, the calculation amount is reduced to less than one third on the whole.

3. Experiments and Analysis

3.1. Data

Experiments are carried out on head CT sequences and heart CT sequences. Both sequences are scanned by Siemens spiral CT. The detail information is shown in Table 1. Taking head for an example, the extents are , and the pixel spacing is 0.486 mm, 0.486 mm and 0.700 mm along , , axis, respectively. The sampling distance along ray is 0.3 mm.

Table 1: Comparison of two sampling methods.

Objects and sizes
Head

512 × 512 × 295
Heart

512 × 512 × 41

Spacing

(mm × mm × mm)
0.486 × 0.486 × 0.700
0.318 × 0.318 × 2.000

Sampling distance (mm)
0.3
0.3

Time by the traditional (s)
58.274
7.192

Time by the proposed (s)
17.158
2.043

Acceleration rate
3.606
3.52

3.2. Results

The reconstructed results of two datasets are shown in Figures 2 and 3. The rendering time of the data is shown in Table 1. For example, it takes 17.158 seconds to render the head sequences with the new sampling method, while 58.274 seconds using the traditional method.

(a) Traditional method

(b) Proposed method

Figure 2: Head images of ray casting.

(a) Traditional method

(b) Proposed method

(c) the details of (a)

(d) the details of (b)

Figure 3: Heart images with ray casting.

3.3. Analysis

The new sampling method does not consult all 3D vertexes of the volume data. For this reason, it is a question whether the image quality can be guaranteed. It can be seen in Figures 2 and 3 that images reconstructed by RCA based on plan cluster sampling method are almost the same as those based on traditional trilinear interpolation in RCA. They can clearly show the details of the boundary and internal information of the volume with the new sampling method. Therefore, the image quality can be well ensured.

By comparing the amount of computation () in the two sampling methods, the new method can reduce the amount of traditional one to about one third. It can be seen that the total rendering time (Table 1) using new method is less than one third of that using conventional trilinear interpolation. It indicates that the time saved to inquire the property of the vertexes not for reference should not be underestimated.

Moreover, it is shown that the acceleration rate of the head images is higher than that of the heart images. The main difference between them is that the spacing of head CT sequences is denser than the heart data. Therefore, the denser the data is, the more efficient the new method is.

4. Conclusion

This paper presented a novel RCA based on a parallel plan cluster sampling method. The proposed method can efficiently speed up the sampling process at more than three times and still clearly display the boundary and internal information of the volume; thus the image quality is well guaranteed. In addition, the comparison of acceleration rate indicates that the new method is more effective for dataset with denser spacing. The new method can meet the real-time requirements of interactive rendering.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (61105073, 61173096, and 61103140) and the Science and Technology Department of Zhejiang Province (R1110679 and 2010C33095).

References

C. Cattani, R. Badea, S. Y. Chen, and M. Crisan, “Biomedical signal processing and modeling complexity of living systems,” Computational and Mathematical Methods in Medicine, vol. 2012, Article ID 298634, 2 pages, 2012.

Y. Mishchenko, “Automation of 3D reconstruction of neural tissue from large volume of conventional serial section transmission electron micrographs,” Journal of Neuroscience Methods, vol. 176, no. 2, pp. 276–289, 2009.

B. Lee, J. Yun, J. Seo, B. Shim, Y. G. Shin, and B. Kim, “Fast high-quality volume ray casting with virtual samplings,” IEEE Transactions on Visualization and Computer Graphics, vol. 16, no. 6, pp. 1525–1532, 2010.

S. Y. Chen and X. Li, “Functional magnetic resonance imaging for imaging neural activity in the human brain: the annual progress,” Computational and Mathematical Methods in Medicine, vol. 2012, Article ID 613465, 9 pages, 2012.

N. Max, “Optical models for direct volume rendering,” IEEE Transactions on Visualization and Computer Graphics, vol. 1, no. 2, pp. 99–108, 1995.

B. Q. Liu, G. J. Clapworthy, F. Dong, and E. C. Prakash, “Octree rasterization accelerating high-quality out-of-core GPU volume rendering,” IEEE Transactions on Visualization and Computer Graphics, no. 99, pp. 1–14, 2012.

F. F. Wei and J. Q. Feng, “Real-time ray casting of algebraic B-spline surfaces,” Computers & Graphics, vol. 35, no. 4, pp. 800–809, 2011.

C. G. Zhang, P. Xi, and C. X. Zhang, “CUDA-based volume ray-casting using cubic B-spline,” in Proceedings of the International Conference on Virtual Reality and Visualization (ICVRV '11), pp. 84–88, November 2011.

A. R. Yang, C. X. Lin, and J. Z. Luo, “A ray-casting approach based on rapid direct interpolation,” Control & Automation, vol. 26, no. 7, pp. 8–10, 2010.

L. Tao and Z. Y. Qian, “An improved fast ray casting volume rendering algorithm of medical image,” in Proceedings of the 4th International Conference on Biomedical Engineering and Informatics (BMEI '11), pp. 109–112, 2011.

Y. Qian, X. Zhang, and J. Lai, “Improved ray casting algorithm,” Computer Engineering and Design, vol. 32, no. 11, pp. 3780–3783, 2011.

J. Meyer-Spradow, T. Ropinski, J. Mensmann, and K. Hinrichs, “Voreen: a rapid-prototyping environment for ray-casting-based volume visualizations,” IEEE Computer Graphics and Applications, vol. 29, no. 6, pp. 6–13, 2009.

H. R. Ke and R. C. Chang, “Ray-cast volume rendering accelerated by incremental trilinear interpolation and cell templates,” The Visual Computer, vol. 11, no. 6, pp. 297–308, 1995.

B. Lee, J. Yun, J. Seo, B. Shim, Y. G. Shin, and B. Kim, “Fast high-quality volume ray casting with virtual samplings,” IEEE Transactions on Visualization and Computer Graphics, vol. 16, no. 6, pp. 1525–1532, 2010.

A. Knoll, Y. Hijazi, R. Westerteiger, M. Schott, C. Hansen, and H. Hagen, “Volume ray casting with peak finding and differential sampling,” IEEE Transactions on Visualization and Computer Graphics, vol. 15, no. 6, pp. 1571–1578, 2009.