- Research article
- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
The accuracy of a designed software for automated localization of craniofacial landmarks on CBCT images
© Shahidi et al.; licensee BioMed Central Ltd. 2014
Received: 18 March 2014
Accepted: 8 September 2014
Published: 16 September 2014
Two-dimensional projection radiographs have been traditionally considered the modality of choice for cephalometric analysis. To overcome the shortcomings of two-dimensional images, three-dimensional computed tomography (CT) has been used to evaluate craniofacial structures. However, manual landmark detection depends on medical expertise, and the process is time-consuming. The present study was designed to produce software capable of automated localization of craniofacial landmarks on cone beam (CB) CT images based on image registration and to evaluate its accuracy.
The software was designed using MATLAB programming language. The technique was a combination of feature-based (principal axes registration) and voxel similarity-based methods for image registration. A total of 8 CBCT images were selected as our reference images for creating a head atlas. Then, 20 CBCT images were randomly selected as the test images for evaluating the method. Three experts twice located 14 landmarks in all 28 CBCT images during two examinations set 6 weeks apart. The differences in the distances of coordinates of each landmark on each image between manual and automated detection methods were calculated and reported as mean errors.
The combined intraclass correlation coefficient for intraobserver reliability was 0.89 and for interobserver reliability 0.87 (95% confidence interval, 0.82 to 0.93). The mean errors of all 14 landmarks were <4 mm. Additionally, 63.57% of landmarks had a mean error of <3 mm compared with manual detection (gold standard method).
The accuracy of our approach for automated localization of craniofacial landmarks, which was based on combining feature-based and voxel similarity-based methods for image registration, was acceptable. Nevertheless we recommend repetition of this study using other techniques, such as intensity-based methods.
Cephalometric analysis is one of the key tools for arriving at an accurate diagnosis, planning treatment, evaluating growth, and research [1–3]. Landmark-based analysis is the most common method for cephalometric analysis . Detection of landmarks plays an essential role in medical diagnosis and treatment planning .
Two-dimensional (2D) projection radiographs have been traditionally considered the modality of choice for orthodontic cephalometric analysis . However, plain radiography has many shortcomings, such as superimposition of structures of the left and right sides of the skull, unequal magnification of bilateral structures , the possibility of distortion of mid-facial structures , and random errors that arise as a result of variations in positioning the patient in the cephalostat .
To overcome these shortcomings, three-dimensional (3D) computed tomography (CT) has been used to evaluate craniofacial structures with less distortion than plain-film views . The introduction of cone beam computed tomography (CBCT) during the past decade offers advantages over plain CT, such as smaller machines, reduced costs, and increased accessibility . With the development of CBCT, 3D assessment of the craniofacial region has become an alternative for patient imaging .
The accuracy and reliability of landmark detection and cephalometric measurements using 3D data gathered using the CBCT technique have been confirmed [1, 4, 9, 11, 12]. For example, it has been shown that 3D images are more accurate and reliable than traditional cephalographic projections for both landmark detection  and measurements . However, using 3D landmark identification is more time-consuming than using conventional 2D cephalographic tracings .
Landmark detection can be performed manually or automatically. Manual landmark detection depends on medical expertise . In addition to the necessity of previous experience, the process is time-consuming and tedious . Hence, there have been efforts to computerize and automate cephalometric analysis based on 2D data  and 3D data [5, 14]. For 2D images, four approaches are available when designing software that can locate cephalometric landmarks (image filtering plus knowledge-based landmark search, model-based approaches, soft-computing approaches, hybrid approaches). Leonardi et al. concluded that the errors in landmark detection using these methods were greater than those experienced with manual tracing, concluding that these systems are not accurate enough for clinical purposes .
To the best of our knowledge, few studies have focused on 3D data. Those that are available were limited to studying 3D surface-rendered models. For example, Mestiri and Hamrouni designed software using Reeb graphs . Pan Zheng et al. used a Visualization Toolkit (VTK) and wrapper language Tcl/tk as a computer-assisted method. They suggested that automatic localization of 3D craniofacial landmarks should be studied in the future .
Although there are problems with manual detection, developing a fully automated system for identifying landmarks remains challenging . We have found no published studies that have attempted to develop software that can detect landmarks based on image registration. Presumably, such an automated system would result in more convenient and accurate measurements. The present study was designed to produce software capable of automated localization of craniofacial landmarks based on image registration. We then evaluated its accuracy.
A total of 28 CBCT images were imported into our newly designed software. After three experts localized 14 landmarks, 8 of the 28 CBCT images were used as reference images to create a head atlas. The remaining 20 CBCT images were used as test images to evaluate our software.
This study was performed in accordance with the Declaration of Helsinki and was approved by the ethics committee of Shiraz University of Medical Sciences (ECSUMS) issued on 07 July 2013 (reference code EC-P-92-5479).
Written informed consent was obtained from each patient for the publication of this report and any accompanying images.
To create the atlas, 8 CBCT images that came from patients with ideal cephalometric measurements (ages 10–45 years, distributed in intervals of about 5 years) were selected from an archive of 500 previously acquired images at one of the two main private oral and maxillofacial radiology centers in Shiraz.
For testing our system, 20 CBCT images were randomly selected from the same archive. They were randomized using a random numbers table. The number selected from the table showed the CBCT code that would be selected from the archive. The inclusion criteria for test images were large field-of-view (FOV) CBCT images of orthodontic patients. Exclusion criteria included images with significant fractures or severe skeletal anomalies. All of the subjects were aged between 10 and 43 years.
Each patient was positioned in the NewTom VGi Cone Beam CT machine (QR SRL Company, Verona, Italy) with the aid of a guide light. The Frankfort horizontal plane (FHP) was parallel to the floor, and the mid-sagittal plane passed through the glabella. The examinations were performed at 4.71 mA and 110 kVp, with a scan time of 3.6 s. The FOV was 15 × 15 cm for all images.
The raw images from the CBCT scan were converted to digital information and communication in medicine (DICOM) three multifiles using the NNT viewer software version 2.21 (Quantitative Radiology, Verona, Italy). The DICOM images were loaded into our new software for localizing the landmarks manually and then automatically.
Technical experts designed the software using MATLAB programming language. This system is capable of presenting images that allow us to locate landmarks manually, reporting the coordinates of landmarks in x, y, and z planes, and detecting landmarks in its automated mode.
Localizing landmarks manually
A total of 14 cephalometric landmarks were located based on the description of the landmarks provided by Zamora et al. . The 14 landmarks were at point A, point B, anterior nasal spine (ANS), posterior nasal spine (PNS), pogonion (Pog), nasion (N), sella (S), gnathion (Gn), menton (Me), right gonion (Go), tip of the right upper central incisor (U1T), apex of the right upper central incisor (U1A), tip of the right lower central incisor (L1T), and apex of the right lower central incisor (L1A).
Creating a 3D cephalometric head atlas
We needed to create a 3D cephalometric head atlas that contained the 14 normal landmarks as a reference model. For accurate registration, it was better to reduce the scaling, translation, and rotation among images. More similarity among the images would eliminate these factors, rendering the registration more accurate. We used each patient’s age as a criterion for the size of his or her head (older patients would have larger heads because of the natural growth process). We then used the eight CBCT images to create the atlas. When the software was presented with a test image, it automatically selected the reference image from among those eight samples based on age-matched data for the test subject and the reference subject.
Automated landmark detection
Evaluation of the software
To evaluate the accuracy of the software regarding its automated detection of landmarks, we compared each landmark’s coordinates generated from the 20 CBCT images by the software to the mean values that experts had determined previously as the reference.
where x 1, y 1, z 1 are coordinates for manual detection and x 2, y 2, z 2 are coordinates for automated detection.
The ICCs and 95% confidence intervals (95% CI) for intraobserver reliability on measurements were 0.86 (0.81 to 0.95) for observer 1; 0.89 (0.83 to 0.96) for observer 2; 0.93 (0.88 to 0.96) for observer 3. The combined ICC for intraobserver reliability was 0.89. The ICC and 95% CI for interobserver reliability were 0.87 and 0.82–0.93.
The Min. error, Max. error, mean error and the standard error of the mean for the 6 manually detected landmarks’ coordinates from the mean of those coordinates as the gold standard
Min. error (mm)
Max. error (mm)
Mean error (mm)
Standard error of the mean (mm)
Percentage of cases with <3 mm mean error
0.45 for Point L1A
2.60 for Point Gn
The Min. error, Max. error, mean error and the standard error of the mean for the automatically identified landmarks in millimeters from the baselines
Min. error (mm)
Max. error (mm)
Mean error (mm)
Standard error of the mean (mm)
Percentage of cases with <3 mm mean error
1.58 mm for Point A
7.10 mm for Point Gn
This study was performed to assess the accuracy of new software that had been specifically designed based on image registration. Its purpose was automated localization of craniofacial landmarks. Our approach was based on volume matching using the whole 3D volume. The mean errors of all 14 landmarks were <4 mm. Also, 63.57% of the landmarks had a mean error of <3 mm compared to manual detection (gold standard method). The mean error for all of the automatically identified landmarks in our study was higher than the mean error for the manually detected landmarks. However, in some studies on 2D images, a distance of ≤4 mm was considered acceptable [17, 18]. De Oliveira et al. stated that the clinical significance of the accuracy of the landmark identification error depends on the level of accuracy required . However, it seems that the acceptability of this error should be further evaluated. Mestiri and Hamrouni proposed a system that was designed to use Reeb graphs for automatic localization of cephalometric landmarks. The authors reported that 18 of 20 landmarks related to just one case were recognized successfully, with errors from baseline of 0.5 to 2.8 mm . Pan Zheng et al. tried to visualize craniofacial landmarks and identify them using a Visualization Toolkit (VTK) and wrapper language Tcl/tk. Their method was not completely automated .
In this study, we used 28 CBCT images from an archive of 500 CBCTs. All the subjects had been positioned in the CBCT machine with the FHP parallel to the floor and the mid-sagittal plane passing through the glabella. Bassam Hassan et al. considered that 3D images were preferred to 2D images because of the higher accuracy they offered in regard to head position. They stated that small variations in the patient’s head position do not influence the measurement accuracy in 3D images, whereas there was a significant difference between the ideal and rotated scan positions for the 2D images .
In our study, three experts manually identified all landmarks in our 28 CBCT images at two separate sessions, ensuring the validity of the coordinates against our gold standard values. We asked them to use 3D surface-rendered models in addition to MPR images because the addition of MPR images to the 3D model can increase the precision of landmark detection. Research performed in 2009 showed that the use of MPR images takes full advantage of the 3D CBCT information, whereas locating landmarks on the 3D renderings alone can lead to error . Bassam Hassan et al. in 2009 stated that performing cephalometric analysis on 3D-rendered models seems to be the most appropriate approach with regard to accuracy and convenience . However, in research published in 2011, Bassam Hassan et al. concluded that addition of MPR images to the 3D model does have a positive influence on precision—but on average takes twice as much time .
The head atlas we created was uniquely designed to provide reference images for image registration. It was based on eight CBCT images from subjects at 5-year age intervals. All of the images were evaluated by experts using the 3D + MPR method, which ensures additional precision. Mestiri and Hamrouni stated that they had created a head atlas assisted by medical staff, but they did not explain their exact method .
A total of 20 CBCT images were used to evaluate the accuracy of our method. This number was considered suitable by the authors. In a systematic review, however, the number of images required to appraise the effectiveness of automated landmark detection in 2D images ranged from 5 to 600 . We could not find similar studies on 3D images that reported such a considerable sample size. In a study performed at the University of El-Manar, only one CT image was used to evaluate the accuracy of their method (Reeb graph) for automated localization of the landmarks. Those authors stated that their method needed to be validated on a larger database . Although we used more images in our study, we recommend repetition of similar studies using a larger sample size.
We used a new method for registration, first proposed by Too et al. They combined the advantages of feature-based and voxel similarity-based methods by converting the volumetric data to a binary volume as a feature, followed by use of Principal Axes Registration (PAR) . We believed PAR to be the most effective one among the feature-based methods because it can find the transformation parameters easily and has less computational complexity . Alpert et al. stated that registration by the principal axes transformation can be accomplished with typical errors in the area of ~1 mm. It also has the advantages of simplicity and speed of computation . To the best of our knowledge, our study is the first conducted to implement and evaluate this method for automated landmark localization on maxillofacial CBCT images.
Although the current study presents a valuable method for automated detection of craniofacial landmarks on CBCT images, it has some limitations. First, we did not exclude images of patients with orthodontic braces. These images were responsible for most of our observed error, which reflects the impact of streak artifacts. We concluded that more errors occur with images of patients who have orthodontic appliances and probably surgical rigid fixation as well.
The radiation dosage in CBCT is another limitation that may limit implementation of this technique. The use of large-volume (craniofacial) CBCT imaging—i.e., the entire facial skeleton—is a common procedure for orthodontic-related radiological assessment by some clinicians [20, 21]. According to the SEDENTEXTC guideline, however, its radiation dose, particularly in pediatric patients, is a challenging issue. The use of large volume CBCT may be justified when planning a definitive procedure in complex cases of skeletal abnormality, particularly those requiring combined orthodontic/surgical management . However, it is not plausible to expose all orthodontic patients to the radiologic dose of CBCT with the intention of cephalometric analysis per se.
The database used in the present study included only Iranian patients. Therefore, our results may not be applicable to other populations. We suggest that further research be undertaken using appropriate databases from other ethnic groups. We also suggest that image registration using other approaches be attempted in the future. Intensity-based methods seem to be accurate and suitable for clinical application . We do recommend evaluations of measurement analyses based on automated landmark detection methods.
We contend that this software is the first to use a combined method (feature-based and voxel similarity-based) for image registration during automated localization of craniofacial landmarks on CBCT images. The accuracy of our method was acceptable. Nevertheless we recommend repetition of this study using other techniques, such as intensity-based methods.
The authors thank the Vice-chancellory of Shiraz University of Medical Sciences for supporting this research (Grant #EC-P-925479). This manuscript is based on the thesis by Dr. Ehsan Bahrampour. The authors also thank Dr. Vosough of the Center of Research Improvement of the School of Dentistry for the statistical analysis.
- Zamora N, Llamas JM, Cibrian R, Gandia JL, Paredes V: Cephalometric measurements from 3D reconstructed images compared with conventional 2D images. Angle Orthod. 2011, 81: 856-864. 10.2319/121210-717.1.View ArticlePubMedGoogle Scholar
- Miller SBDM: Computer-aided head film analysis: the University of California San Francisco method. Am J Orthod. 1980, 78: 41-65. 10.1016/0002-9416(80)90039-1.View ArticlePubMedGoogle Scholar
- Forsyth DB, Shaw WC, Richmond S, Roberts CT: Digital imaging of cephalometric radiographs, Part 2: Image quality. Angle Orthod. 1996, 66: 43-50.PubMedGoogle Scholar
- Ludlow JB, Gubler M, Cevidanes L, Mol A: Precision of cephalometric landmark identification: cone-beam computed tomography vs conventional cephalometric views. Am J Orthod Dentofacial Orthop. 2009, 136: 312-10.1016/j.ajodo.2009.04.009. e311-310; discussion 312-313View ArticlePubMedPubMed CentralGoogle Scholar
- Makram M, Kamel H: Reeb Graph for Automatic 3D Cephalometry. IJIP. 2014, 8: 17-29.Google Scholar
- Hassan B, van der Stelt P, Sanderink G: Accuracy of three-dimensional measurements obtained from cone beam computed tomography surface-rendered images for cephalometric analysis: influence of patient scanning position. Eur J Orthod. 2009, 31: 129-134. 10.1093/ejo/cjn088.View ArticlePubMedGoogle Scholar
- Chen YJ, Chen SK, Yao JC, Chang HF: The effects of differences in landmark identification on the cephalometric meaurements in traditional versus digitized cephalometry. Angle Orthod. 2004, 74: 155-161.PubMedGoogle Scholar
- Houston WJB: The analysis of errors in orthodontic measurements. Am 1 Orthod. 1983, 83: http://www.ncbi.nlm.nih.gov/pubmed/?term=Houston+WJB%3A+The+analysis+of+errors+in+orthodontic+measurements+Am+1+Orthod+1983%2C+83,Google Scholar
- Bassam H, Peter N, Hans V, Jamshed T, Christian V, van der Stelt P, Beek H: Percision of identifying cephalometric landmarks with cone beam computed tomography in vivo. Euro J Orthodontics. 2011, doi:10.1093/ejo/cjr050Google Scholar
- Gribel BF, Gribel MN, Manzi FR, Brooks SL, McNamara JA: From 2D to 3D: an algorithm to derive normal values for 3-dimensional computerized assessment. Angle Orthod. 2011, 81: 3-10. 10.2319/032910-173.1.View ArticlePubMedGoogle Scholar
- Couceiro CP, Vilella OV: 2D/3D Cone-Beam CT images or convensional radiography: Which is more reliable?. Dental Press J Orthod. 2010, 15: 40-41. 10.1590/S2176-94512010000500007.View ArticleGoogle Scholar
- de Oliveira AE, Cevidanes LH, Phillips C, Motta A, Burke B, Tyndall D: Observer reliability of three-dimensional cephalometric landmark identification on cone-beam computerized tomography. Oral Surg Oral Med Oral Pathol Oral Radiol Endod. 2009, 107: 256-265. 10.1016/j.tripleo.2008.05.039.View ArticlePubMedGoogle Scholar
- Shahidi S, Oshagh M, Gozin F, Salehi P, Danaei S: Accuracy of computerized automatic identification of cephalometric landmarks by a designed software. Dentomaxillofac Radiol. 2013, 42: 20110187-10.1259/dmfr.20110187.View ArticlePubMedPubMed CentralGoogle Scholar
- Pan Z, Bahari B, Rozniza Z, Arash I, Rajion ZA: Computerized 3D Craniofacial Landmark Identification and Analysis. eJCSIT. 2009, 1:Google Scholar
- Rosalia L, Daniela G, Francesco M, Spampinato C: Automatic Cephalometric Analysis A Systematic Review. Angle Orthod. 2008, 78: 145-10.2319/120506-491.1.View ArticleGoogle Scholar
- Naw Chit TJ, Xuenan C, Shengzhe L, Hakil K: Fast and Accurate Rigid Registration of 3D CT Images by Combining Feature and Intensity. J Comp Sci Eng. 2012, 6: 1-11. 10.5626/JCSE.2012.6.1.1.View ArticleGoogle Scholar
- Yue W, Yin D, Li C, Wang G, Xu T: Automated 2-D cephalometric analysis on X-ray images by a model-based approach. IEEE Trans Biomed Eng. 2006, 53: 1615-1623.View ArticlePubMedGoogle Scholar
- El-Feghi IS-AM, Ahmadi M: Automatic localization of craniofacial landmarks for assisted cephalometry. Pattern Recognit. 2004, 37: 609-621. 10.1016/j.patcog.2003.09.002.View ArticleGoogle Scholar
- Alpert NM, Bradshaw JF, Kennedy D, Correia JA: The principal axes transformation–a method for image registration. J Nuc Med. 1990, 31: 1717-1722.Google Scholar
- Kapila S, Conley RS, Harrell WE: The current status of cone beam computed tomography imaging in orthodontics. Dentomaxillofac Radiol. 2011, 40: 24-34. 10.1259/dmfr/12615645.View ArticlePubMedPubMed CentralGoogle Scholar
- Smith BRPJ, Cederberg RA: An evaluation of cone-beam computed tomography use in postgraduate orthodontic programs in the United States and Canada. J Dent Educ. 2011, 75: 98-106.PubMedGoogle Scholar
- Radiation protection: cone beam CT for dental and maxillofacial radiology. Evidence based guidelines. 2011, SEDENTEXCT Project [http://www.sedentexct.eu/files/guidelines_final.pdf],
- Hill DL, Studholme C, Hawkes DJ: "Voxel similarity measures for automated image registration," Visualization in Biomedical Computing. 1994, Bellingham, WA: SPIE, 205-Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2342/14/32/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.