Skip to main content
  • Research article
  • Open access
  • Published:

The application and accuracy of feature matching on automated cephalometric superimposition

Abstract

Background

The aim of this study was to establish a computer-aided automated method for cephalometric superimposition and to evaluate the accuracy of this method based on free-hand tracing.

Methods

Twenty-eight pairs of pre-treatment (T1) and post-treatment (T2) cephalograms were selected. Structural superimpositions of the anterior cranial base, maxilla and mandible were independently completed by three operators performing traditional hand tracing methods and by computerized automation using the feature matching algorithm. To quantitatively evaluate the differences between the two methods, the hand superimposed patterns were digitized. After automated and hand superimposition of T2 cephalograms to T1 cephalometric templates, landmark distances between paired automated and hand T2 cephalometric landmarks were measured. Differences in hand superimposition among the operators were also calculated.

Results

The T2 landmark differences in hand tracing between the operators ranged from 0.61 mm to 1.65 mm for the three types of superimposition. There were no significant differences in accuracy between hand and automated superimposition (p > 0.05).

Conclusions

Computer-aided cephalometric superimposition provides comparably accurate results to those of traditional hand tracing and will provide a powerful tool for academic research.

Peer Review reports

Background

Since the introduction of cephalometry in 1931 by Broadbent [1], it has become an important tool in clinical diagnosis, treatment planning, evaluation of treatment changes and growth study. The traditional method of cephalometric analysis is hand tracing the craniofacial soft and hard anatomic structural contours on cephalograms on acetate paper. This process is subjective, and the accuracy varies with personal experience, knowledge, understanding of craniofacial anatomy and tracking preference [2,3,4,5,6]. Additionally, this process is time-consuming, and the accuracy is also inevitably influenced by the human fatigue level [7, 8]. In particular, for the purpose of research, a certain number of cephalograms need to be traced and measured within a certain time constraint, and the intra−/inter-reproducibility is impacted.

With the development of digital technology, the traditional hand tracing cephalogram is being replaced by digital cephalometric analysis. In previous studies, the latter method, using commercial software, has been proven to be accurate, reliable and time-saving [8,9,10,11,12]. However, the only exception is the structural superimposition for treatment evaluation and growth study, although much effort has been made in this field [3, 12,13,14]. The reason for this exception lies in the fact that landmark identification is easily accomplished using commercial software, while structural superimposition focuses on the tracing of structural details, which is independent of landmarks and is still not feasible using current commercial software.

Baumrind et al. believed that hand superimpositions resulted in better quality than any computer-aided superimpositions, because biological craniofacial growth is difficult to be interpreted by any mathematical equations [2]. However, due to the absolute consistency, fully automated cephalometric analysis has always been a popular challenge in computer science. One of these methods is the knowledge-based line extraction technique [15], which duplicates the strategy of orthodontists by extracting important anatomic edges and locating landmarks according to geometric definitions. However, the irregular details of bone, such as the inter-trabeculae, incisor nerve canal and inferior alveolar canal, make computer automated tracing difficult and questionable. Other studies have attempted to locate landmarks directly [16, 17], and the techniques have evolved from template matching [16] to, more recently, neural network models [17]. In terms of structural superimposition on stable regions instead of reference planes, which has been recognised as the most accurate method [18,19,20,21,22], why not use the same strategy?

Feature matching is a computer algorithm [23, 24] whose mission is to detect and match keypoints of the same or similar regions in multiple images taken at different viewpoints, under different illuminations, or at different magnifications. In comparison with the traditional manual process of superimposing the stable structures of two serial cephalograms, this method bears many similarities. One of the algorithms, Oriented FAST and Rotated BRIEF(ORB) [23], was shown to be time-saving for the matching process, rotational-invariant and noise-immune. However, two aspects of this method should be improved for clinical applications: (1) the area for detecting and matching keypoints should be limited to the stable regions on the cephalograms; and (2) to achieve accurate matching results, the matches should be not only abundant but also of high quality.

Currently, studies describing methods for automated cephalometric structural superimposition are scarce. Therefore, the present study aimed to (1) establish a computer-aided automated method of structural superimposition on the anterior cranial base, maxilla and mandible and (2) evaluate its accuracy based on free-hand tracing and superimposition.

Methods

The institutional review board for the protection of human subjects reviewed and approved the research protocol (IRB-201626016).

A total of 28 pairs of pre- (T1) and post-treatment (T2) cephalograms were selected. They were taken by the same X-ray machine. The subjects consisted of 21 females and 7 males. The age for T1 ranged from 12 to 27 years, with a mean age of 15.32 years; the T2 ages ranged from 14 to 29 years, with a mean age of 18.03 years. The experimental design is shown in Fig. 1. Calibration rulers were used to control distortions and resolution errors during the printing and scanning process.

Fig. 1
figure 1

Schematic flowchart of the experimental design

Landmark identifications

One operator identified landmarks on the T1 and T2 digital lateral films using customised software produced by the State Key Laboratory of Virtual Reality Technology and Systems. The landmarks included the upper reference point (URP), lower reference point (LRP), sella (S), nasion (N), pterygoid point (Pt), posterior nasal spine (PNS), anterior nasal spine (ANS), subspinale (A), supramental (B), pogonion (Pg), menton (Me), gonion (Go), condylion (Co), upper incisor edge (UIE), upper incisor root apex (UIA), upper first molar mesial buccal cusp (UM), upper first molar mesial root apex (UMA), lower incisor edge (LIE), lower incisor apex (LIA), lower first molar mesial buccal cusp (LM), and lower first molar mesial apex (LMA).

Superimposition methodology

The structural superimposition method developed by Johnston [25] for the anterior cranial base, maxilla and mandible was independently conducted by each operator.

Hand tracing superimposition

Three senior orthodontic residences, who finished the superimposition course in our department and attended the hands-on lecture given by Johnston in person, were selected as operators in this study. They independently performed hand tracings of T1 and T2 side by side on acetate paper. Information from the hand superimposition was recorded using a similar method as that developed by the University of California, San Francisco [11]. A series of ten pinholes were drilled into T1 films in the non-information-bearing area surrounding the anatomic region of interest. Four corner pinholes on the T1 films, called positioning reference pinholes, were used to register the scanned hand tracings onto corresponding digital films. The other six pinholes on the T1 films, called superimposing reference pinholes, were used in pairs to register the between-film relationships onto T2 tracings for the three types of hand superimposition methods and to convert the between-film relationship of the hand superimpositions into a digital record by scanning. For the T2 films, only the four corner pinholes were drilled. The lateral films with pinholes and the corresponding hand tracings were scanned (HP Color LaserJet 2840, Hewlett-Packard Company, Palo Alto, CA, USA) in original size and at 600 dpi. The operators identified the scanned pinholes that carried the information on superimposition and image size from the T1 and T2 tracings.

Automated superimposition

Figure 2a shows the rectangular region of interest enclosed by landmarks on the anterior cranial base, maxilla and mandible used to detect the keypoints. On the anterior cranial base, this area was defined by the URP, S, Pt and N. On the maxilla, this area was enclosed by the Pt, PNS, ANS and A. On the mandible, this area was enclosed by the LM, Pg, Me and Go.

Fig. 2
figure 2

a The rectangular areas mainly consisting of stable structures were used to detect keypoints enclosed by landmarks on the anterior cranial base, maxilla and mandible. A. Area on the Anterior cranial base: URP-S-Pt-Na. B. Area on the maxilla: Pt-PNS-ANS-A. C. Area on the mandible: LM-Pg-Me-Go. b The flowchart of feature matching process and automated superimposition on maxilla

The ORB’s oriented FAST algorithm [23, 26] was used to detect keypoints on each confined area. We then used the ORB’s steer BRIEF [23] algorithm for keypoint description, a modified algorithm used to solve the problem that BRIEF is not rotationally invariant. Finally, a brute-force Hamming distance [27] was used to match keypoints on two cephalograms.

Considering that the ORB results might not be completely accurate, the Grid-based Motion Statistics for Fast, Ultra-robust Feature Correspondence (GMS) [24] algorithm was applied to filter the matching results. Then, we calculated the relative offset distances and rotation angles of each pair of successfully matched keypoints and transferred the T2 cephalogram onto the T1 image accordingly. The automated superimposition results were exported as Photoshop files.

Figure 2b shows the flowchart of the automated superimposition process on maxilla.

Calculation of T2 landmark distances

Photoshop CC 2017 (Adobe, San Jose, CA, USA) was used to register hand tracings onto the corresponding digital cephalograms. The T1 cephalograms in each automated superimposition file were used as templates to measure the T2 landmark distances (T2LDs). The T1 tracings were registered onto the templates by 4 positioning reference pinholes. To avoid landmark identification errors, one operator used the automatically superimposed T2 cephalograms to identify landmarks by the brush tool with a 3-pixel diameter and noted down the landmarks’ coordinators as automated superimposition results. Then, the T2 cephalograms were duplicated, and the corresponding T2 tracings were registered on duplicated films at four positioning reference pinholes. Subsequently, they were superimposed onto the templates registered by the bilateral superimposing reference pinholes of the same superimposition type as the automated one. Finally, the landmarks’ coordinators on the duplicated T2 cephalograms as the operator’s hand superimposition results were noted down. Before importing the next operator’s tracings, we deleted the tracings of the previous one to prevent mutual influence of the superimposition results among operators.

To calculate the operative differences of hand superimposition, T2LDs between operators’ corresponding coordinators were measured (Fig. 3).

Fig. 3
figure 3

Pairwise T2LD for hand superimposition between different operators

Before evaluating hand superimposition accuracy, the average coordinators among three operators’ coordinators for each landmark were set as the true values. The T2LDs between each operator’s coordinators and the corresponding true values were measured.

To evaluate the accuracy of automated superimposition, the T2LDs were calculated between the coordinators of automated superimpositions and the corresponding true values.

Statistical methods

Statistical analyses were carried out with SPSS 25.0 (SPSS Inc., Chicago, IL, USA). The mean T2LDs of operative differences in hand superimposition, hand superimposition accuracy and automated superimposition accuracy for multiple cephalometric landmarks under each superimposition method were calculated. A paired t-test was applied to examine the statistical accuracy of automated superimposition with hand superimposition. P-values less than 0.05 were considered significant.

Results

The mean T2LDs between operators on the anterior cranial base, maxilla and mandible superimposition methods are listed in Tables 1, 2 and 3, respectively. In the anterior cranial base superimposition (Table 1), the mean T2LD at the pterygory point showed the least difference (Pt, 0.61 ± 0.63 mm), while the mean T2LD at the menton showed the greatest difference (Me, 1.02 ± 0.96 mm). In the mandibular superimposition (Table 2), the mean T2LD at the condylion showed the greatest difference (Co, 1.65 ± 1.24 mm), and the least difference was observed on the LIE (0.62 ± 0.86 mm), followed by the other midline structures (LIA, 0.76 ± 0.55 mm; B point, 0.75 ± 53 mm; Pg, 0.75 ± 0.48 mm; and Me, 0.70 ± 0.45 mm). However, the operator differences in the maxilla were quite close between the landmarks (Table 3), ranging from 0.78 mm to 0.82 mm.

Table 1 Mean operative differences in T2 landmark distance (mm) between operators. Paired t-test results for the accuracy between hand and automated superimposition, both compared with true values in cranial base superimposition
Table 2 Mean operative differences in T2 landmark distance (mm) between operators. Paired t-test results for the accuracy between manual and automated superimposition, both compared with true values in maxillary superimposition
Table 3 Mean operative differences in T2 landmark distance (mm) between operators. Paired t-test results for the accuracy between manual and automated superimposition, both compared with true values in mandibular superimposition

The accuracy of automated superimposition on three superimposition methods by the paired t-test is shown in Tables 1, 2 and 3. Hand superimposition showed slightly higher accuracy compared with paired automated superimposition. However, there were no statistically significant differences (p > 0.05) between the two operations in all selected cephalometric landmarks of interest.

Discussion

Decades ago, researchers studying craniofacial growth in the presence of metallic implants advocated superimposing structures that are stable during growth [18,19,20], and structural superimposition has been verified as the most accurate technique [21, 22]. However, two remaining issues need to be considered. First, in some films with low quality or high complexity due to overlapping structures, it is impossible for orthodontists to determine a sufficient number of stable structures, especially in the maxilla and mandible. Second, if several stable structures do not fit appropriately in the same between-film position, the orthodontists must defer to their biological knowledge and practical experience. Both of these limitations weaken the reliability of hand structural superimposition.

Landmark identifications are the main source of cephalometric errors [28, 29]. To avoid this type of error and to focus mainly on the reliability and accuracy of superimposition, we carried out our study using film duplication and between-film registration techniques. As shown in Tables 1, 2 and 3, the differences between operators on three types of superimpositions varied greatly from 0.61 mm to 1.65 mm, a range that was greater than the intra-operator reliability reported by Huja et al. [3]. This finding suggests that the inter-operator variability of superimposition is an important variation of results. In our study, we infer that rotational effects produced a greater number of errors than those produced by translational effects on the superimposition of the anterior cranial base and mandible, which were similar to the results from Baumrind et al. [2] and Cook et al. [6]. However, we also found that the mean T2LDs of the six landmarks in the maxillary superimposition were quite similar to each other without showing a progressive trend from any centre. This observation suggests that the translational error may have been the predominant cause of error in maxillary superimposition.

The differences in accuracy between hand and automated superimposition are smaller than the variability among operators but also demonstrate a similar increase in error tendency with spatial patterning on the anterior cranial base and mandibular superimpositions. Although slightly higher accuracy errors were observed on the automated superimpositions, there were no significant differences between the two methods in comparison of the differences in accuracy with the true values determined by the paired t-test. This finding suggests that compared with hand tracing, automated superimposition does not lead to a significant increase in error and has the great advantages of absolute consistency and time-efficiency. However, a considerable number of high-quality keypoints would favour better accuracy, which relies on the distinction of stable structures from background by a sharp contrast in pixel intensity. An improvement in image quality, along with advancement of the sensitivity for keypoint detection, would solve the problems of this technique.

From a clinical perspective, considering the time-consuming nature and questionable accuracy of hand cephalometric superimposition when a large number of cases are required for statistical analysis, this automated method could benefit big data analysis using digital cephalograms.

Conclusions

Computer-aided cephalometric superimposition provides comparable results to those of traditional hand tracing when structural superimposition is concerned. With the help of proper software, this method for digital filmless cephalometry will provide a powerful tool for academic research.

Availability of data and materials

The full datasets used and analysed during the current study are available on reasonable request from the corresponding authors at tmxuortho@163.com and kqbinghan@bjmu.edu.cn.

Abbreviations

A:

Subspinale

ANS:

Anterior nasal spine

B:

Supramental

BRIEF:

Binary Robust Independent Elementary Features

Co:

Condylion

FAST:

Features from Accelerated Segment Test

GMS:

Grid-based Motion Statistics for Fast, Ultra-robust Feature Correspondence

Go:

Gonion

LIA:

Lower incisor apex

LIE:

Lower incisor edge

LM:

Lower first molar mesial buccal cusp

LMA:

Lower first molar mesial apex

LRP:

Lower reference point

Me:

Menton

N:

Nasion

ORB:

Oriented FAST and Rotated BRIEF

Pg:

Pogion

PNS:

Posterior nasal spine

Pt:

Pterygoid point

S:

Sella

T1 :

Pre-treatment

T2 :

Post-treatment

T2LDs:

T2 landmark distances

UIA:

Upper incisor apex

UIE:

Upper incisor edge

UM:

Upper first molar mesial buccal cusp

UMA:

Upper first molar mesial apex

URP:

Upper reference point

References

  1. Broadbent BH. A new x-ray technique and its application to orthodontia. The introduction of cephalometric radiology. Angle Orthod. 1931;1(1):45–66.

    Google Scholar 

  2. Baumrind S, Miller D, Molthen R. The reliability of head film measurements: 3. Tracing superimposition. Am J Orthod. 1976;70(6):617–44.

    Article  CAS  Google Scholar 

  3. Huja SS, Grubaugh EL, Rummel AM, Fields HW, Beck FM. Comparison of hand-traced and computer-based Cephalometric superimpositions. Angle Orthod. 2009;79(3):428–35.

    Article  CAS  Google Scholar 

  4. Gilddon MJ, Xia JJ, Gateno J, Wong HTF, Lasky RE, Teichgraeber JF, Jia XL, Liebschner MAK, Lemoine JJ. The accuracy of Cephalometric tracing superimposition. J Oral Maxillofac Surg. 2006;64(2):194–202.

    Article  Google Scholar 

  5. Roden-Johnston D, English J, Gallerano R. Comparison of hand-traced and computerized cephalograms: landmark identification, measurement, and superimposition accuracy. Am J Orthod Dentofac Orthop. 2008;133(4):556–64.

    Article  Google Scholar 

  6. Cook PA, Gravely JF. Tracing error with Björk’s mandibular superimposition. Angle Orthod. 1988;58(2):169–78.

    CAS  PubMed  Google Scholar 

  7. Tsorovas G, Karsten AL. A comparison of hand-tracing and cephalometric analysis computer programs with and without advanced feature accuracy and time demands. Eur J Orthod. 2010;32(5):721–8.

    Article  Google Scholar 

  8. Yue WN, Yin DL, Li CJ, Wang GP, Xu TM. 2006. Automated 2-D Cephalometric analysis on X-ray image by a model-based approach. IEEE Trans Biomed Eng. 2006;53(8):1615–23.

    Article  Google Scholar 

  9. Chen YJ, Chen SK, Yao JC, Chang HF. The effects of differences in landmark identification on the cephalometric measurements in traditional versus digitized cephalometry. Angle Orthod. 2004;74(2):155–61.

    PubMed  Google Scholar 

  10. Ongkosuwito EM, Katsaros C, van’t Hof MA, Bodegom JC, Kuijpers-Jagtaman AM. The reproducibility of cephalometric measurements: a comparison of analogue and digital methods. Eur J Orthod. 2002;24(6):655–65.

    Article  CAS  Google Scholar 

  11. Baumrind S, Miller D. Computer-aided head film analysis: the University of California san Francisco method. Am J Orthod. 1980;78(1):41–65.

    Article  CAS  Google Scholar 

  12. Polat-Ozsoy O, Gokcelik A, Toygar Memikoglu TU. Differences in cephalometric measurements: a comparison of digital versus hand-tracing methods. Eur J Orthod. 2009;31(3):254–9.

    Article  Google Scholar 

  13. Jacquet W, Nyssen E, Bottenberg P, de Groen P, Vande VB. Novel information theory based method for superimposition of lateral head radiographs and cone beam computed tomography images. Dentomaxillofac Radiol. 2019;39(8):191–8.

    Google Scholar 

  14. Nabipour S, OH H, Boyd R, Baumrind S. Comparative reliability of cephalometric superimpositions: computer monitor versus acetate standard. IADR Thursday, March 17, 2011: 3:30 p.m. -4:45 p.m.

  15. Lévy-Mandel AD, Venetsanopoulos AN, Tsotsos JK. Knowledge-based landmarking of cephalograms. Comput Biomed Res. 1986;19(3):282–309.

    Article  Google Scholar 

  16. Cardillo J, Sid-Ahmed MA. An image processing system for locating craniofacial landmarks. IEEE Trans Med Imaging. 1994;13(2):275–89.

    Article  CAS  Google Scholar 

  17. Arik SÖ, Ibragimov B, Xing L. Fully automated quantitative cephalometry using convolutional neural networks. J Med Imaging (Bellingham). 2017;4(1):014501.

    Article  Google Scholar 

  18. Bjork A, Skieller V. Roentgencephalometric growth analysis of the maxilla. Trans Eur Orthod Soc. 1977;7:209–33.

    Google Scholar 

  19. Bjork A. Facial growth in man studied with the aid of metallic implants. Acta Odontol Scand. 1955;13(1):9–34.

    Article  CAS  Google Scholar 

  20. Bjork A. Variations in the growth pattern of the human mandible: longitudinal radiographic study by the implant method. J Dent Res. 1963;42(1):400–11.

    Article  Google Scholar 

  21. Nielsen IL. Maxillary superimposition: a comparison of three methods for cephalometric evaluation of growth and treatment change. Am J Orthod Dentofac Orthop. 1989;95(5):422–31.

    Article  CAS  Google Scholar 

  22. Gu Y, McNamara JA Jr. Cephalometric superimpositions. Angle Orthod. 2008;78(6):967–76.

    Article  Google Scholar 

  23. Rublee E, Rabaud V, Konolige K, Bradski GR. ORB: an efficient alternative to SIFT or SURF. IEEE International Conference on Computer Vision, ICCV 2011. Barcelona: IEEE; 2011.

  24. Bian JW, Lin WY, Matsushita Y, Yeung SK, Nguyen TD, Cheng MM. GMS: grid-based motion statistics for Fast, ultra robust feature correspondence. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu: 2017. p. 2828–37.

  25. Johnston LE Jr. Balancing the books on orthodontic treatment: an integrated analysis of change. Br J Orthod. 1996;23(2):93–102.

    Article  Google Scholar 

  26. Rosten E, Drummond T. Machine learning for highspeed corner detection. In: Computer Vision—ECCV; 2006. p. 430–43.

    Google Scholar 

  27. Al-Okaily A. Error tree: a tree structure for hamming & edit distances & wildcards matching. J Comput Biol. 2015;22(12):1118–28.

    Article  CAS  Google Scholar 

  28. Baumrind S, Frantz RC. The reliability of head film measurements:1. Landmark identification. Am J Orthod. 1971;60(2):111–27.

    Article  CAS  Google Scholar 

  29. Baumrind S, Frantz RC. The reliability of head film measurements:2. Conventional angular and linear measures. Am J Orthod. 1971;60(5):505–17.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

The manuscript was proofread by a native English professional with a science background at American Journal Experts.

Funding

This study was financially supported by the Beijing Nature Science Foundation (7192227) to establish the method for automated superimposition, by the National Natural Science Foundation of China (51972005, 51672009) and the Research Foundation of Peking University School and Hospital of Stomatology (PKUSS20190115) for sample collection and data acquisition.

Author information

Authors and Affiliations

Authors

Contributions

Contribution to conception and design: JYR, SGY, YXN, DYB, LQF, LSQ, HB and XTM; Contribution to data acquisition and interpretation: JYR and SGY; Contribution to performance of all statistical analyses: JYR; Contribution to drafting of manuscript: JYR and DYB; Contribution to critical revision of manuscript: SGY, YXN, LQF, LSQ, HB and XTM. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Bing Han or Tianmin Xu.

Ethics declarations

Ethics approval and consent to participate

The institutional review board for the protection of human subjects reviewed and approved the research protocol (IRB-201626016).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, Y., Song, G., Yu, X. et al. The application and accuracy of feature matching on automated cephalometric superimposition. BMC Med Imaging 20, 31 (2020). https://doi.org/10.1186/s12880-020-00432-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12880-020-00432-z

Keywords