Journal of Healthcare Engineering
Volume 2018 (2018), Article ID 4950131, 8 pages
https://doi.org/10.1155/2018/4950131

Research Article

A Method for Tooth Model Reconstruction Based on Integration of Multimodal Images

Xinwen Zhou,1,2 Yangzhou Gan,2,3 Jing Xiong,² Dongxia Zhang,² Qunfei Zhao,¹ and Zeyang Xia2,3

¹Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
²Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
³CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institutes of Advanced Technology, Shenzhen 518055, China

Correspondence should be addressed to Zeyang Xia; zy.xia@siat.ac.cn

Received 17 November 2017; Accepted 7 May 2018; Published 20 June 2018

Academic Editor: Yong Xia

Copyright © 2018 Xinwen Zhou et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

A complete digital tooth model is needed for computer-aided orthodontic treatment. However, current methods mainly use computed tomography (CT) images to reconstruct the tooth model which may require multiple CT scans during orthodontic progress, and the reconstructed model is also inaccurate in crown area. This study developed a tooth model reconstruction method based on integration of CT images and laser scan images to overcome these disadvantages. In the method, crown models and complete tooth models are first reconstructed, respectively, from laser scan images and CT images. Then, crown models from laser scan images and tooth models from CT images are registered. Finally, the crown from laser scan images and root from CT images were fused to obtain a new tooth model. Experimental results verified that the developed method is effective to generate the complete tooth model by integrating CT images and laser scan images. Using the proposed method, the reconstructed models provide more accurate crown than CT images, and it is feasible to obtain complete tooth models at any stage of orthodontic treatment by using one CT scan at the pretreatment stage and one laser scan at that stage to avoid multiple CT scans.

1. Introduction

In clinical orthodontics, a digital three-dimensional (3D) complete tooth model is needed for diagnosis, treatment planning, appliance design, tooth movement monitoring, and so on. With the development of the imaging and computer techniques, it is feasible to reconstruct digital tooth models from 3D dental images to conduct computer-aided orthodontic treatment.

Currently, laser scan images and computed tomography (CT) images are the most widely used 3D images in clinical orthodontics. Laser scan images have a high resolution up to ten-micron level, and the reconstructed tooth models have been used in space analysis, diagnosis, and computer-aided design of personalized orthodontic appliance, and so on [1–3]. However, the laser scan images only provide the 3D information of crown surface, and CT images is necessary in these applications where 3D information of root is needed including tooth arrangement, tooth movement monitoring, and orthodontic treatment simulation [4–7]. Complete 3D tooth models can be reconstructed from CT images [8, 9]. However, the reconstructed model from CT images is inaccurate in the crown area to be employed for personalized orthodontic appliance design due to the low image resolution [10]. In addition, multiple CT scans are needed in clinic for progress and posttreatment records, which is not recommended, since the subject would be exposed to high level of radiation [10, 11].

In this study, a new tooth model reconstruction method based on integration of laser scan images and CT images was developed. Crown models and complete tooth models were first reconstructed, respectively, from laser scan images and CT images. The crown models and tooth models were then registered to align the crown part of the two types of models. New complete tooth models were finally generated by fusing the crown from laser scan images and root from CT images. The fusion of laser scan images and CT images is challenging. It is difficult to extract the virtual root boundary (the boundary to be combined with the crown from laser scan images) from the CT tooth model because of the complex boundary of laser crown. Additionally, it is difficult to combine the registered crown and root models since the density of vertexes of the two models is inconsistent due to different image spatial resolutions of two sources.

Compared to the previous tooth model reconstruction method from laser scan images or CT images, the contribution of this study mainly includes two aspects. First, the reconstructed tooth model using the developed method can provide the complete 3D information of tooth, and the crown part is accurate enough to be applied for appliance design. Second, by applying the developed method, it is feasible to obtain the complete tooth model at any stage of orthodontic treatment by using one CT scan at pretreatment stage and one laser scan at that stage to avoid multiple CT scans.

2. Methods

The framework of the tooth model reconstruction method based on integration of laser scan images and CT images is shown in Figure 1. The laser crown models (Figure 1(b)) and completed CT tooth models (Figure 1(d)) are firstly segmented and reconstructed from laser scan images (Figure 1(a)) and CT images (Figure 1(c)), respectively. The two types of models are then registered (Figure 1(e)) using principal component analysis (PCA) algorithm [12] and iterative closest point (ICP) algorithm [13] to align their crown parts. Finally, the crowns from laser scan images and roots from CT images are fused to generate new tooth models (Figure 1(f)) using the Delaunay-based region-growing method [14].

Figure 1: Framework of the tooth model reconstruction method based on integration of laser scan images and CT images. (a) Laser scan images of mandibular; (b) individual crowns segmented from laser scan images; (c) CT images of mandibular; (d) 3D tooth models reconstructed from CT images; (e) registration of crown models from laser scan images and CT images; (f) tooth models reconstruction by fusing crowns from the laser scan images and roots from CT images.

2.1. Crown Model Segmentation from Laser Scan Images

The triangular mesh model (Figure 2(a)) including all tooth crown surface in stereolithographic format is automatically obtained from the laser scanner. Individual tooth crown models (Figure 2(d)) are segmented from the mesh model by applying a modified fast watershed mesh segmentation method.

Figure 2: Modified fast watershed mesh segmentation method for individual crown model segmentation. (a) Mesh model from laser scanning of mandibular; (b) manually selected seed points of each crown (green points) and presegmentation result in the occlusion area of each crown; (c) height function distribution of facets; (d) individual crown segmented using the modified fast watershed mesh segmentation method.

In the commonly used fast watershed mesh segmentation method [15], a height function is defined based on the curvature of triangular facet to extract the boundary of neighboring mesh models. However, over segmentation may occur when using this method, and the method may fail to segment individual crowns due to the slow curvature change at the boundary between neighboring crowns. In this study, a modified fast watershed mesh segmentation algorithm is developed to segment individual crowns. Compared to the commonly used fast watershed mesh segmentation method, the modification mainly includes the following two points. (1) A region-growing algorithm [16] is applied to presegment the occlusion area of each crown to avoid over segmentation of the commonly used fast watershed mesh segmentation method (Figure 2(b)). (2) Both curvature and area of triangular facet are employed to define a height function to extract boundary of neighboring crowns (Figure 2(c)). For a given triangular facet , the height function between and one of its first-order neighboring triangular facets is written as

where represents the 1-neighboring facets of , is the area of a facet, is the curvature of and [15], and is the weight factor which could be adjusted according to the model. In this study, is empirically set to be 0.16.

2.2. Tooth Segmentation and Reconstruction from CT Images

To reconstruct the complete tooth model from CT images (Figure 3(a)), tooth contours (Figure 3(c)) are first segmented from transverse section slice-by-slice (Figure 3(b)) using the hybrid level set-based method [8, 9], and 3D tooth surface model (Figure 3(d)) is reconstructed from the segmented tooth contours using the Marching Cube algorithm [17]. In the procedure of tooth contour segmentation (Figure 3(b)), a user first manually selects a starting slice from the crown part of the volumetric CT images and picks seed points for each tooth in this slice. Then, the tooth contour is segmented slice-by-slice automatically from the CT images. The automatic segmentation starts from the selected starting slice and propagates along the crown and root directions for crown and root segmentation, respectively. For each slice, the Radon transform is employed to extract a separation line of neighboring teeth [9], and the hybrid level set model is then applied to segment each tooth contour from the mesial and distal sides of the corresponding separation line. Tooth contour propagation strategy which uses segmented tooth contour of previous slice as the tooth shape prior to current slice is employed to initialize the tooth contour automatically. More details of the hybrid level set-based tooth contour segmentation method can be found in [8].

Figure 3: Framework of tooth segmentation and reconstruction from CT images. (a) CT images; (b) tooth contour segmentation slice-by-slice; (c) segmented individual tooth region in each slice; (d) reconstructed tooth models from the segmented tooth region using marching cube algorithm.

2.3. Registration of Crown Models from CT Images and Laser Scan Images

In this study, the aim of model registration is to align the crown part of the two types of models. For the simplicity of computation, the tooth model reconstructed from CT images is sectioned using a plane to generate a crown model for registration with the crown model from laser scan images. The registration between the two types of models is performed through two steps: a coarse registration step based on PCA algorithm [12] and a fine registration step based on ICP algorithm [13]. During the registration process, the crown models from laser scan images are fixed, and the crown models from CT images are registered to the laser scan crown models.

In the coarse registration using PCA algorithm, the covariance matrix of each model is calculated, respectively, from the corresponding node coordinates. Three orthogonal unit eigenvectors are then extracted from the covariance matrixes, respectively, to establish the body-fitted coordinate system of the corresponding mesh model, and the origin of the coordinate system is set at the centroid of all the mesh model nodes. The aim of coarse registration is to find an affine transformation matrix such that the two body-fitted coordinate systems can be aligned after the affine transformation. Let and be the covariance matrixes of crown models from laser scan images and CT images, respectively, and and be the corresponding eigenvector matrixes. The rotation matrix and the translation matrix of the affine transformation can be obtained as follows:

where is the matrix inverse operator, and are the node sets of the two mesh models, respectively, and is the centroid of the node set operator. Then an affine transformation is performed on using and , to generate the coarse registration result .

The fine registration using ICP algorithm aims at finding a set of affine transformation matrixes such that the mean square error (MSE) of the distance between the corresponding nodes of the laser scan crown and the coarsely registered CT crown models achieve minimum after the affine transformations. Let and denote the number of nodes in and , respectively. The procedure of the ICP algorithm for the fine registration is conducted as follows.

 Step 1. Build the kd-tree [18] of and , respectively. Step 2. Calculate the rotation matrix and translation matrix using the quaternion method [13]. Step 3. Transform using an affine transformation with parameters and . Step 4. For each node in , search its nearest node in and calculate the corresponding Euclidean distance between and . The registration error is defined as

 Step 5. Go back to step 2 until the registration error is smaller than a preset threshold .

2.4. Fusion of Crown from Laser Scan Images and Root from CT Images

In this study, the Delaunay-based region-growing (DBRG) algorithm [14] is applied to generate a new tooth model by fusing the crown models from laser scan images and root models from CT images. In this procedure, each tooth model is proceeded independently using the DBRG algorithm. Two sets of triangle denoted by and , respectively, and a set of edges denoted by are defined. The fusion of the laser scan crown and CT root models is performed as follows:

 Step 1. Calculate the Delaunay triangulation of all the vertexes in the two registered models. Step 2. Choose a starting triangle from , put the starting triangle into , and put its edges into (the starting triangle is selected from those triangles with a largest z coordinate of vertexes and minimum circumradius). Step 3. Calculate the local smooth degree (LSD) of these triangles in who have edges in and put these triangles into (the definition of LSD can be found in [14]). Step 4. Denote the triangle with the largest LSD in by and check whether the local geometry and topology between and triangles in is correct. If it is correct, (a) remove from , (b) put into , (c) put edges of into , and (d) delete the edges in that are no longer the boundary edges of . If not, remove from and repeat Step 4 until is empty. Step 5. Go back to Step 3 until is empty.

3. Experiments

This study was reviewed and approved by Institutional Review Board of Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences. Written informed consents of the subjects are obtained. Intraoral laser scan images and CBCT images of five subjects (4 male, 1 female; average age 18 ± 1.9) with crowded teeth in need of orthodontic treatment are obtained at the pretreatment stage. The laser scan images and CBCT images have isotropic voxel sizes of 50 μm and 0.125 mm, respectively.

3.1. Results of Model Reconstruction from 3D Images

Tooth models of one subject reconstructed from laser scan images and CBCT images are shown in Figures 4(a) and 4(b), respectively. Visually, the crown models reconstructed from laser scan images provide more detail information of crown than those from CBCT images.

Figure 4: Crown and tooth model reconstruction results of one subject. (a) Crown models reconstructed from laser scan images; (b) tooth models reconstructed from CBCT images.

3.2. Results of Crown Model Registration

The superimposed crown models from laser scan images and CBCT images of one subject after model registration are shown in Figure 5, and the corresponding registration error distribution of nodes is shown in Figure 6.

Figure 5: Crown registration results from lingual view (a) and labial view (b). Red: the crown model based on CT images; gray: the crown model based on laser scan images.

Figure 6: Error map of registration result from lingual view (a) and labial view (b), and the histogram of distance between the corresponding nodes of two model (c).

In this study, the average distance (AD) from the laser scan crown model to the registered CT crown model is applied to quantify the registration error of the two models. The registration error for all the tested subjects is 0.19 ± 0.03 mm, and the registration error of each subject is listed in Table 1.

Table 1: Registration error of each subject.

Subjects
AD (mm)

Subject 1
0.18

Subject 2
0.16

Subject 3
0.23

Subject 4
0.21

Subject 5
0.17

All
0.19 ± 0.03

3.3. Results of Model Fusion

For all the tested images, new tooth models are successfully generated based on the fusion of the crown from laser scan images and the root from CT images. Figure 7 shows the generated tooth models of one subject based on the fusion. Compared to the models directly reconstructed from laser scan images and CT images in Figure 4, the models obtained by the fusion method not only contain the complete 3D tooth information but also provide accurate crown.

Figure 7: Tooth models from the fusion of crown from laser scan images and root from CT images. (a) Lingual view of fused tooth models; (b) labial view of fused tooth models.

4. Discussion

In computer-aided orthodontics, complete 3D digital tooth models are needed for diagnosis, treatment planning, and treatment simulation. One can reconstruct the complete tooth models from CT images. However, the reconstructed models are inaccurate in the crown part for personalized appliance design. Additionally, multiple CT scans are necessary for progress and posttreatment records if only using the CT image to reconstruct the tooth models. Compared with CT images, laser scan images can be used to reconstruct much more accurate crown models without radiation [19, 20]. In this study, we developed a new tooth model reconstruction method based on the fusion of the crown model from laser scan images and root model from CT images. By applying the developed method, it was feasible to obtain the complete tooth model at any stage of orthodontic treatment by using one CT scan at pretreatment stage and one laser scan at that stage to avoid multiple CT scans. Additionally, the reconstructed tooth model using the developed method provided more accurate crown than CT images.

In the developed method, the crown models from laser scan images and the tooth models from CT images are first registered and then fused to generate the complete tooth models, and both the registration and fusion procedure would affect the accuracy of the reconstructed model. In previous works of the dental model registration, the mean registration errors are among 0.1 mm and 0.3 mm [21–23]. In this study, the mean registration error in the developed method is 0.19 mm and is clinically acceptable [24]. To evaluate the model fusion error, the laser scan crown is chosen as the ground truth and compared with the fused tooth model, and AD was used to quantify the fusion error. The error map of one subject is shown in Figure 8. For all the tested subjects, the fusion error is 0.015 ± 0.004 mm which is rather small and clinically acceptable [25], and the fusion error of each subject is listed in Table 2.

Figure 8: Error between the laser scan crown model and the tooth models from the fusion procedure. (a) Lingual view; (b) labial view; (c) histogram of the error.

Table 2: Fusion error of each subject.

Subjects
AD (mm)

Subject 1
0.014

Subject 2
0.011

Subject 3
0.020

Subject 4
0.017

Subject 5
0.013

All
0.015 ± 0.004

In the developed method, manual initialization is needed for the segmentation of CT images and laser scan images which leaded to limited difference of segmentation results for different trained users [8, 15]. While the registration and fusion procedure are performed fully automatically, we could thus achieve results with good reproducibility and reliability compared to those manually operating works [21, 25]. The proposed method may fail to reconstruct angled teeth since the slice-by-slice image segmentation strategy used in the method has difficulty in the segmentation of these teeth [26].

5. Conclusion

This study presented a new tooth model reconstruction method based on integration of laser scan images and CBCT images. Compared to those commonly used tooth model reconstructed methods which directly reconstruct complete tooth model from CT images, the proposed method can generate tooth model with more accurate crown and can obtain a complete tooth model at any stage of orthodontic treatment by using one CT scan at pretreatment stage and one laser scan at that stage to avoid multiple CT scans. Thus, the proposed tooth model reconstruction method based on image integration can benefit the computer-aided orthodontic treatment.

Conflicts of Interest

The authors declare no conflicts of interest.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (61601452), Guangdong Natural Science Funds for Distinguished Young Scholar (2015A030306020), Youth Innovation Promotion Association, Chinese Academy of Sciences (2015301), and Shenzhen Research Project (JCYJ20170818162801483, JCYJ20170413162458312, GJHS20160331185913023, and GJHS20170314154158554).

References

S. Mullen, C. Martin, P. Ngan, and M. Gladwin, “Accuracy of space analysis with emodels and plaster models,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 132, no. 3, pp. 346–352, 2007.

N. Motohashi and T. Kuroda, “A 3D computer-aided design system applied to diagnosis and treatment planning in orthodontics and orthognathic surgery,” European Journal of Orthodontics, vol. 21, no. 3, pp. 263–274, 1999.

L. Liu, B. He, J. Zhuang, L. Zhang, and A. Lv, “Force measurement system for invisalign based on thin film single force sensor,” Measurement, vol. 97, pp. 1–7, 2017.

H. Tong, D. Kwon, J. Shi, N. Sakai, R. Enciso, and G. Sameshima, “Mesiodistal angulation and faciolingual inclination of each whole tooth in 3-dimensional space in patients with near-normal occlusion,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 141, no. 5, pp. 604–617, 2012.

A. Yagci, I. Veli, T. Uysal, F. Ucar, T. Ozer, and S. Enhos, “Dehiscence and fenestration in skeletal class I, II, and III malocclusions assessed with cone-beam computed tomography,” Angle Orthodontist, vol. 82, no. 1, pp. 67–74, 2012.

Z. Librizzi, Z. Kalajzic, D. Camacho, S. Yadav, R. Nanda, and F. Uribe, “Comparison of the effects of three surgical techniques on the rate of orthodontic tooth movement in a rat model,” Angle Orthodontist, vol. 87, no. 5, pp. 717–724, 2017.

J. Gao, W. Xu, and Z. Ding, “3D finite element mesh generation of complicated tooth model based on CT slices,” Computer Methods and Programs in Biomedicine, vol. 82, no. 2, pp. 97–105, 2006.

Y. Gan, Z. Xia, J. Xiong, Q. Zhao, Y. Hu, and J. Zhang, “Toward accurate tooth segmentation from computed tomography images using a hybrid level set model,” Medical Physics, vol. 42, no. 1, pp. 14–27, 2015.

Z. Xia, Y. Gan, J. Xiong, Q. Zhao, and J. Chen, “Crown segmentation from computed tomography images with metal artifacts,” IEEE Signal Process Letters, vol. 23, no. 5, pp. 678–682, 2016.

G. Swennen, E. Barth, C. Eulzer, and F. Schutyser, “The use of a new 3D splint and double CT scan procedure to obtain an accurate anatomic virtual augmented model of the skull,” International Journal of Oral and Maxillofacial Surgery, vol. 36, no. 2, pp. 146–152, 2007.

A. Alqerban, G. Willems, C. Bernaerts, J. Vangastel, C. Politis, and R. Jacobs, “Orthodontic treatment planning for impacted maxillary canines using conventional records versus 3D CBCT,” European Journal of Orthodontics, vol. 36, no. 6, pp. 698–707, 2014.

I. Jolliffe, Principal Component Analysis, Springer, New York, NY, USA, 1986.

P. Besl and N. McKay, “A method for registration of 3-D shapes,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239–256, 1992.

C. Kuo and H. Yau, “Delaunay-based region-growing approach to surface reconstruction from unorganized points,” Computer-Aided Design, vol. 37, no. 8, pp. 825–835, 2005.

C. Li, C Zhang, and G. Wang, “Fast marker-controlled interactive mesh segmentation,” Acta Scientiarum Naturalium Universitatis Pekinensis, vol. 42, no. 5, pp. 662–667, 2006, in Chinese.

R. Adams and L. Bischof, “Seeded region growing,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, no. 6, pp. 641–647, 1994.

W. E. Lorensen and H. Cline, “Marching cubes: a high resolution 3D surface construction algorithm,” ACM SIGGRAPH Computer Graphics, vol. 21, no. 4, pp. 163–169, 1987.

I. Wald and V. Havran, “On building fast kd-trees for ray tracing, and on doing that in O (N log N),” in Proceedings of the IEEE Symposium on Interactive Ray Tracing, pp. 61–69, Lake Tahoe, NV, USA, November 2006.

D. R. Stevens, C. Flores-Mir, B. Nebbe, D. W. Raboud, G. Heo, and P. W. Major, “Validity, reliability, and reproducibility of plaster vs. digital study models: comparison of peer assessment rating and Bolton analysis and their constituent measurements,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 129, no. 6, pp. 794–803, 2006.

C. Kau, S. Richmond, A. Zhurov et al., “Reliability of measuring facial morphology with a 3-dimensional laser scanning system,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 128, no. 4, pp. 424–430, 2005.

H.-H. Lin, W.-C. Chiang, L.-J. Lo, S. S.-P. Hsu, C.-H. Wang, and S.-Y. Wan, “Artifact-resistant superimposition of digital dental models and cone-beam computed tomography images,” Journal of Oral and Maxillofacial Surgery, vol. 71, no. 11, pp. 1933–1947, 2013.

J. Uechi, M. Okayama, T. Shibata et al., “A novel method for the 3-dimensional simulation of orthognathic surgery by using a multimodal image-fusion technique,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 130, no. 6, pp. 786–798, 2006.

G. Swennen, M. Mommaerts, J. Abeloos et al., “A cone-beam CT based technique to augment the 3D virtual skull model with a detailed dental surface,” International Journal of Oral and Maxillofacial Surgery, vol. 38, no. 1, pp. 48–57, 2009.

C. Dietrich, A. Ender, S. Baumgartner, and A. Mehl, “A validation study of reconstructed rapid prototyping models produced by two technologies,” Angle Orthodontist, vol. 87, no. 5, pp. 782–787, 2017.

T. Kihara, K. Tanimoto, M. Michida et al., “Construction of orthodontic setup models on a computer,” American Journal of Orthodontics and Dentofacial Orthopedics, vol. 141, no. 6, pp. 806–813, 2012.

Y. Gan, Z. Xia, J. Xiong, G. Li, and Q. Zhao, “Tooth and alveolar bone segmentation from dental computed tomography images,” IEEE Journal of Biomedical and Health Informatics, vol. 22, no. 1, pp. 196–204, 2018.