A complete digital tooth model is needed for computer-aided orthodontic treatment. However, current methods mainly use computed tomography (CT) images to reconstruct the tooth model which may require multiple CT scans during orthodontic progress, and the reconstructed model is also inaccurate in crown area. This study developed a tooth model reconstruction method based on integration of CT images and laser scan images to overcome these disadvantages. In the method, crown models and complete tooth models are first reconstructed, respectively, from laser scan images and CT images. Then, crown models from laser scan images and tooth models from CT images are registered. Finally, the crown from laser scan images and root from CT images were fused to obtain a new tooth model. Experimental results verified that the developed method is effective to generate the complete tooth model by integrating CT images and laser scan images. Using the proposed method, the reconstructed models provide more accurate crown than CT images, and it is feasible to obtain complete tooth models at any stage of orthodontic treatment by using one CT scan at the pretreatment stage and one laser scan at that stage to avoid multiple CT scans.
National Natural Science Foundation of China61601452Natural Science Foundation of Guangdong Province2015A030306020Youth Innovation Promotion Association of the Chinese Academy of Sciences2015301Shenzhen Research ProjectJCYJ20170818162801483JCYJ20170413162458312GJHS20160331185913023GJHS201703141541585541. Introduction
In clinical orthodontics, a digital three-dimensional (3D) complete tooth model is needed for diagnosis, treatment planning, appliance design, tooth movement monitoring, and so on. With the development of the imaging and computer techniques, it is feasible to reconstruct digital tooth models from 3D dental images to conduct computer-aided orthodontic treatment.
Currently, laser scan images and computed tomography (CT) images are the most widely used 3D images in clinical orthodontics. Laser scan images have a high resolution up to ten-micron level, and the reconstructed tooth models have been used in space analysis, diagnosis, and computer-aided design of personalized orthodontic appliance, and so on [1–3]. However, the laser scan images only provide the 3D information of crown surface, and CT images is necessary in these applications where 3D information of root is needed including tooth arrangement, tooth movement monitoring, and orthodontic treatment simulation [4–7]. Complete 3D tooth models can be reconstructed from CT images [8, 9]. However, the reconstructed model from CT images is inaccurate in the crown area to be employed for personalized orthodontic appliance design due to the low image resolution [10]. In addition, multiple CT scans are needed in clinic for progress and posttreatment records, which is not recommended, since the subject would be exposed to high level of radiation [10, 11].
In this study, a new tooth model reconstruction method based on integration of laser scan images and CT images was developed. Crown models and complete tooth models were first reconstructed, respectively, from laser scan images and CT images. The crown models and tooth models were then registered to align the crown part of the two types of models. New complete tooth models were finally generated by fusing the crown from laser scan images and root from CT images. The fusion of laser scan images and CT images is challenging. It is difficult to extract the virtual root boundary (the boundary to be combined with the crown from laser scan images) from the CT tooth model because of the complex boundary of laser crown. Additionally, it is difficult to combine the registered crown and root models since the density of vertexes of the two models is inconsistent due to different image spatial resolutions of two sources.
Compared to the previous tooth model reconstruction method from laser scan images or CT images, the contribution of this study mainly includes two aspects. First, the reconstructed tooth model using the developed method can provide the complete 3D information of tooth, and the crown part is accurate enough to be applied for appliance design. Second, by applying the developed method, it is feasible to obtain the complete tooth model at any stage of orthodontic treatment by using one CT scan at pretreatment stage and one laser scan at that stage to avoid multiple CT scans.
2. Methods
The framework of the tooth model reconstruction method based on integration of laser scan images and CT images is shown in Figure 1. The laser crown models (Figure 1(b)) and completed CT tooth models (Figure 1(d)) are firstly segmented and reconstructed from laser scan images (Figure 1(a)) and CT images (Figure 1(c)), respectively. The two types of models are then registered (Figure 1(e)) using principal component analysis (PCA) algorithm [12] and iterative closest point (ICP) algorithm [13] to align their crown parts. Finally, the crowns from laser scan images and roots from CT images are fused to generate new tooth models (Figure 1(f)) using the Delaunay-based region-growing method [14].
Framework of the tooth model reconstruction method based on integration of laser scan images and CT images. (a) Laser scan images of mandibular; (b) individual crowns segmented from laser scan images; (c) CT images of mandibular; (d) 3D tooth models reconstructed from CT images; (e) registration of crown models from laser scan images and CT images; (f) tooth models reconstruction by fusing crowns from the laser scan images and roots from CT images.
2.1. Crown Model Segmentation from Laser Scan Images
The triangular mesh model (Figure 2(a)) including all tooth crown surface in stereolithographic format is automatically obtained from the laser scanner. Individual tooth crown models (Figure 2(d)) are segmented from the mesh model by applying a modified fast watershed mesh segmentation method.
Modified fast watershed mesh segmentation method for individual crown model segmentation. (a) Mesh model from laser scanning of mandibular; (b) manually selected seed points of each crown (green points) and presegmentation result in the occlusion area of each crown; (c) height function distribution of facets; (d) individual crown segmented using the modified fast watershed mesh segmentation method.
In the commonly used fast watershed mesh segmentation method [15], a height function is defined based on the curvature of triangular facet to extract the boundary of neighboring mesh models. However, over segmentation may occur when using this method, and the method may fail to segment individual crowns due to the slow curvature change at the boundary between neighboring crowns. In this study, a modified fast watershed mesh segmentation algorithm is developed to segment individual crowns. Compared to the commonly used fast watershed mesh segmentation method, the modification mainly includes the following two points. (1) A region-growing algorithm [16] is applied to presegment the occlusion area of each crown to avoid over segmentation of the commonly used fast watershed mesh segmentation method (Figure 2(b)). (2) Both curvature and area of triangular facet are employed to define a height function to extract boundary of neighboring crowns (Figure 2(c)). For a given triangular facet t1, the height function Ht1,t2 between t1 and one of its first-order neighboring triangular facets t2 is written as(1)Ht1,t2=wareat1+areat2maxareati+1−wCt1,t2,where ti represents the 1-neighboring facets of t1, area⋅ is the area of a facet, Ct1,t2 is the curvature of t1 and t2 [15], and w is the weight factor which could be adjusted according to the model. In this study, w is empirically set to be 0.16.
2.2. Tooth Segmentation and Reconstruction from CT Images
To reconstruct the complete tooth model from CT images (Figure 3(a)), tooth contours (Figure 3(c)) are first segmented from transverse section slice-by-slice (Figure 3(b)) using the hybrid level set-based method [8, 9], and 3D tooth surface model (Figure 3(d)) is reconstructed from the segmented tooth contours using the Marching Cube algorithm [17]. In the procedure of tooth contour segmentation (Figure 3(b)), a user first manually selects a starting slice from the crown part of the volumetric CT images and picks seed points for each tooth in this slice. Then, the tooth contour is segmented slice-by-slice automatically from the CT images. The automatic segmentation starts from the selected starting slice and propagates along the crown and root directions for crown and root segmentation, respectively. For each slice, the Radon transform is employed to extract a separation line of neighboring teeth [9], and the hybrid level set model is then applied to segment each tooth contour from the mesial and distal sides of the corresponding separation line. Tooth contour propagation strategy which uses segmented tooth contour of previous slice as the tooth shape prior to current slice is employed to initialize the tooth contour automatically. More details of the hybrid level set-based tooth contour segmentation method can be found in [8].
Framework of tooth segmentation and reconstruction from CT images. (a) CT images; (b) tooth contour segmentation slice-by-slice; (c) segmented individual tooth region in each slice; (d) reconstructed tooth models from the segmented tooth region using marching cube algorithm.
2.3. Registration of Crown Models from CT Images and Laser Scan Images
In this study, the aim of model registration is to align the crown part of the two types of models. For the simplicity of computation, the tooth model reconstructed from CT images is sectioned using a plane to generate a crown model for registration with the crown model from laser scan images. The registration between the two types of models is performed through two steps: a coarse registration step based on PCA algorithm [12] and a fine registration step based on ICP algorithm [13]. During the registration process, the crown models from laser scan images are fixed, and the crown models from CT images are registered to the laser scan crown models.
In the coarse registration using PCA algorithm, the covariance matrix of each model is calculated, respectively, from the corresponding node coordinates. Three orthogonal unit eigenvectors are then extracted from the covariance matrixes, respectively, to establish the body-fitted coordinate system of the corresponding mesh model, and the origin of the coordinate system is set at the centroid of all the mesh model nodes. The aim of coarse registration is to find an affine transformation matrix such that the two body-fitted coordinate systems can be aligned after the affine transformation. Let CMlaser and CMCT be the covariance matrixes of crown models from laser scan images and CT images, respectively, and EMlaser and EMCT be the corresponding eigenvector matrixes. The rotation matrix R1 and the translation matrix T1 of the affine transformation can be obtained as follows:(2)R1=EMlaser⋅InvEMCT,T1=CentroidPlaser−R1⋅CentroidPCT,where Inv⋅ is the matrix inverse operator, PCT and Plaser are the node sets of the two mesh models, respectively, and Centroid⋅ is the centroid of the node set operator. Then an affine transformation is performed on PCT using R1 and T1, to generate the coarse registration result PCCT.
The fine registration using ICP algorithm aims at finding a set of affine transformation matrixes such that the mean square error (MSE) of the distance between the corresponding nodes of the laser scan crown and the coarsely registered CT crown models achieve minimum after the affine transformations. Let M and N denote the number of nodes in PCCT and Plaser, respectively. The procedure of the ICP algorithm for the fine registration is conducted as follows.
Step 1. Build the kd-tree [18] of PCCT and Plaser, respectively.
Step 2. Calculate the rotation matrix Rint and translation matrix Tint using the quaternion method [13].
Step 3. Transform PCCT using an affine transformation with parameters Rint and Tint.
Step 4. For each node nii=1,…,M in PCCT, search its nearest node njj=1,…,N in Plaser and calculate the corresponding Euclidean distance Dij between ni and nj. The registration error EC is defined as
(3)EC=∑i=1MDij2M,
Step 5. Go back to step 2 until the registration error EC is smaller than a preset threshold Eth.
2.4. Fusion of Crown from Laser Scan Images and Root from CT Images
In this study, the Delaunay-based region-growing (DBRG) algorithm [14] is applied to generate a new tooth model by fusing the crown models from laser scan images and root models from CT images. In this procedure, each tooth model is proceeded independently using the DBRG algorithm. Two sets of triangle denoted by F and RQ, respectively, and a set of edges denoted by E are defined. The fusion of the laser scan crown and CT root models is performed as follows:
Step 1. Calculate the Delaunay triangulation T of all the vertexes in the two registered models.
Step 2. Choose a starting triangle from T, put the starting triangle into F, and put its edges into E (the starting triangle is selected from those triangles with a largest z coordinate of vertexes and minimum circumradius).
Step 3. Calculate the local smooth degree (LSD) of these triangles in T who have edges in E and put these triangles into RQ (the definition of LSD can be found in [14]).
Step 4. Denote the triangle with the largest LSD in RQ by t0 and check whether the local geometry and topology between t0 and triangles in F is correct. If it is correct, (a) remove t0 from RQ, (b) put t0 into F, (c) put edges of t0 into E, and (d) delete the edges in E that are no longer the boundary edges of F. If not, remove t0 from RQ and repeat Step 4 until RQ is empty.
Step 5. Go back to Step 3 until RQ is empty.
3. Experiments
This study was reviewed and approved by Institutional Review Board of Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences. Written informed consents of the subjects are obtained. Intraoral laser scan images and CBCT images of five subjects (4 male, 1 female; average age 18 ± 1.9) with crowded teeth in need of orthodontic treatment are obtained at the pretreatment stage. The laser scan images and CBCT images have isotropic voxel sizes of 50 μm and 0.125 mm, respectively.
3.1. Results of Model Reconstruction from 3D Images
Tooth models of one subject reconstructed from laser scan images and CBCT images are shown in Figures 4(a) and 4(b), respectively. Visually, the crown models reconstructed from laser scan images provide more detail information of crown than those from CBCT images.
Crown and tooth model reconstruction results of one subject. (a) Crown models reconstructed from laser scan images; (b) tooth models reconstructed from CBCT images.
3.2. Results of Crown Model Registration
The superimposed crown models from laser scan images and CBCT images of one subject after model registration are shown in Figure 5, and the corresponding registration error distribution of nodes is shown in Figure 6.
Crown registration results from lingual view (a) and labial view (b). Red: the crown model based on CT images; gray: the crown model based on laser scan images.
Error map of registration result from lingual view (a) and labial view (b), and the histogram of distance between the corresponding nodes of two model (c).
In this study, the average distance (AD) from the laser scan crown model to the registered CT crown model is applied to quantify the registration error of the two models. The registration error for all the tested subjects is 0.19 ± 0.03 mm, and the registration error of each subject is listed in Table 1.
Registration error of each subject.
Subjects
AD (mm)
Subject 1
0.18
Subject 2
0.16
Subject 3
0.23
Subject 4
0.21
Subject 5
0.17
All
0.19 ± 0.03
3.3. Results of Model Fusion
For all the tested images, new tooth models are successfully generated based on the fusion of the crown from laser scan images and the root from CT images. Figure 7 shows the generated tooth models of one subject based on the fusion. Compared to the models directly reconstructed from laser scan images and CT images in Figure 4, the models obtained by the fusion method not only contain the complete 3D tooth information but also provide accurate crown.
Tooth models from the fusion of crown from laser scan images and root from CT images. (a) Lingual view of fused tooth models; (b) labial view of fused tooth models.
4. Discussion
In computer-aided orthodontics, complete 3D digital tooth models are needed for diagnosis, treatment planning, and treatment simulation. One can reconstruct the complete tooth models from CT images. However, the reconstructed models are inaccurate in the crown part for personalized appliance design. Additionally, multiple CT scans are necessary for progress and posttreatment records if only using the CT image to reconstruct the tooth models. Compared with CT images, laser scan images can be used to reconstruct much more accurate crown models without radiation [19, 20]. In this study, we developed a new tooth model reconstruction method based on the fusion of the crown model from laser scan images and root model from CT images. By applying the developed method, it was feasible to obtain the complete tooth model at any stage of orthodontic treatment by using one CT scan at pretreatment stage and one laser scan at that stage to avoid multiple CT scans. Additionally, the reconstructed tooth model using the developed method provided more accurate crown than CT images.
In the developed method, the crown models from laser scan images and the tooth models from CT images are first registered and then fused to generate the complete tooth models, and both the registration and fusion procedure would affect the accuracy of the reconstructed model. In previous works of the dental model registration, the mean registration errors are among 0.1 mm and 0.3 mm [21–23]. In this study, the mean registration error in the developed method is 0.19 mm and is clinically acceptable [24]. To evaluate the model fusion error, the laser scan crown is chosen as the ground truth and compared with the fused tooth model, and AD was used to quantify the fusion error. The error map of one subject is shown in Figure 8. For all the tested subjects, the fusion error is 0.015 ± 0.004 mm which is rather small and clinically acceptable [25], and the fusion error of each subject is listed in Table 2.
Error between the laser scan crown model and the tooth models from the fusion procedure. (a) Lingual view; (b) labial view; (c) histogram of the error.
Fusion error of each subject.
Subjects
AD (mm)
Subject 1
0.014
Subject 2
0.011
Subject 3
0.020
Subject 4
0.017
Subject 5
0.013
All
0.015 ± 0.004
In the developed method, manual initialization is needed for the segmentation of CT images and laser scan images which leaded to limited difference of segmentation results for different trained users [8, 15]. While the registration and fusion procedure are performed fully automatically, we could thus achieve results with good reproducibility and reliability compared to those manually operating works [21, 25]. The proposed method may fail to reconstruct angled teeth since the slice-by-slice image segmentation strategy used in the method has difficulty in the segmentation of these teeth [26].
5. Conclusion
This study presented a new tooth model reconstruction method based on integration of laser scan images and CBCT images. Compared to those commonly used tooth model reconstructed methods which directly reconstruct complete tooth model from CT images, the proposed method can generate tooth model with more accurate crown and can obtain a complete tooth model at any stage of orthodontic treatment by using one CT scan at pretreatment stage and one laser scan at that stage to avoid multiple CT scans. Thus, the proposed tooth model reconstruction method based on image integration can benefit the computer-aided orthodontic treatment.
Conflicts of Interest
The authors declare no conflicts of interest.
Acknowledgments
This work was supported by the National Natural Science Foundation of China (61601452), Guangdong Natural Science Funds for Distinguished Young Scholar (2015A030306020), Youth Innovation Promotion Association, Chinese Academy of Sciences (2015301), and Shenzhen Research Project (JCYJ20170818162801483, JCYJ20170413162458312, GJHS20160331185913023, and GJHS20170314154158554).
MullenS.MartinC.NganP.GladwinM.Accuracy of space analysis with emodels and plaster models2007132334635210.1016/j.ajodo.2005.08.0442-s2.0-34548419317MotohashiN.KurodaT.A 3D computer-aided design system applied to diagnosis and treatment planning in orthodontics and orthognathic surgery199921326327410.1093/ejo/21.3.2632-s2.0-0033143572LiuL.HeB.ZhuangJ.ZhangL.LvA.Force measurement system for invisalign based on thin film single force sensor2017971710.1016/j.measurement.2016.11.0182-s2.0-84995772476TongH.KwonD.ShiJ.SakaiN.EncisoR.SameshimaG.Mesiodistal angulation and faciolingual inclination of each whole tooth in 3-dimensional space in patients with near-normal occlusion2012141560461710.1016/j.ajodo.2011.12.0182-s2.0-84860461373YagciA.VeliI.UysalT.UcarF.OzerT.EnhosS.Dehiscence and fenestration in skeletal class I, II, and III malocclusions assessed with cone-beam computed tomography2012821677410.2319/040811-250.12-s2.0-84855522058LibrizziZ.KalajzicZ.CamachoD.YadavS.NandaR.UribeF.Comparison of the effects of three surgical techniques on the rate of orthodontic tooth movement in a rat model201787571772410.2319/123016-940.12-s2.0-85032371728GaoJ.XuW.DingZ.3D finite element mesh generation of complicated tooth model based on CT slices20068229710510.1016/j.cmpb.2006.02.0082-s2.0-33646163037GanY.XiaZ.XiongJ.ZhaoQ.HuY.ZhangJ.Toward accurate tooth segmentation from computed tomography images using a hybrid level set model2015421142710.1118/1.49015212-s2.0-84917705898XiaZ.GanY.XiongJ.ZhaoQ.ChenJ.Crown segmentation from computed tomography images with metal artifacts201623567868210.1109/lsp.2016.25457022-s2.0-84964925961SwennenG.BarthE.EulzerC.SchutyserF.The use of a new 3D splint and double CT scan procedure to obtain an accurate anatomic virtual augmented model of the skull200736214615210.1016/j.ijom.2006.09.0192-s2.0-33846842009AlqerbanA.WillemsG.BernaertsC.VangastelJ.PolitisC.JacobsR.Orthodontic treatment planning for impacted maxillary canines using conventional records versus 3D CBCT201436669870710.1093/ejo/cjt1002-s2.0-84922503547JolliffeI.1986New York, NY, USASpringerBeslP.McKayN.A method for registration of 3-D shapes199214223925610.1109/34.1217912-s2.0-0026821209KuoC.YauH.Delaunay-based region-growing approach to surface reconstruction from unorganized points200537882583510.1016/j.cad.2004.09.0112-s2.0-14944382821LiC.ZhangCWangG.Fast marker-controlled interactive mesh segmentation2006425662667in ChineseAdamsR.BischofL.Seeded region growing199416664164710.1109/34.2959132-s2.0-0028444401LorensenW. E.ClineH.Marching cubes: a high resolution 3D surface construction algorithm198721416316910.1145/37402.374222-s2.0-0023381475WaldI.HavranV.On building fast kd-trees for ray tracing, and on doing that in O (N log N)Proceedings of the IEEE Symposium on Interactive Ray TracingNovember 2006Lake Tahoe, NV, USA6169StevensD. R.Flores-MirC.NebbeB.RaboudD. W.HeoG.MajorP. W.Validity, reliability, and reproducibility of plaster vs. digital study models: comparison of peer assessment rating and Bolton analysis and their constituent measurements2006129679480310.1016/j.ajodo.2004.08.0232-s2.0-33744934225KauC.RichmondS.ZhurovA.Reliability of measuring facial morphology with a 3-dimensional laser scanning system2005128442443010.1016/j.ajodo.2004.06.0372-s2.0-26444617546LinH.-H.ChiangW.-C.LoL.-J.HsuS. S.-P.WangC.-H.WanS.-Y.Artifact-resistant superimposition of digital dental models and cone-beam computed tomography images201371111933194710.1016/j.joms.2013.06.1992-s2.0-84886094429UechiJ.OkayamaM.ShibataT.A novel method for the 3-dimensional simulation of orthognathic surgery by using a multimodal image-fusion technique2006130678679810.1016/j.ajodo.2006.03.0252-s2.0-33845315061SwennenG.MommaertsM.AbeloosJ.A cone-beam CT based technique to augment the 3D virtual skull model with a detailed dental surface2009381485710.1016/j.ijom.2008.11.0062-s2.0-58149468345DietrichC.EnderA.BaumgartnerS.MehlA.A validation study of reconstructed rapid prototyping models produced by two technologies201787578278710.2319/01091-727.12-s2.0-85032332136KiharaT.TanimotoK.MichidaM.Construction of orthodontic setup models on a computer2012141680681310.1016/j.ajodo.2011.10.0272-s2.0-84861618988GanY.XiaZ.XiongJ.LiG.ZhaoQ.Tooth and alveolar bone segmentation from dental computed tomography images201822119620410.1109/jbhi.2017.27094062-s2.0-85040311395