In dentistry, panoramic X-ray images are extensively used by dentists for tooth structure analysis and disease diagnosis. However, the manual analysis of these images is time-consuming and prone to misdiagnosis or overlooked. While deep learning techniques have been employed to segment teeth in panoramic X-ray images, accurate segmentation of individual teeth remains an underexplored area. In this study, we propose an end-to-end deep learning method that effectively addresses this challenge by employing an improved combinatorial loss function to separate the boundaries of adjacent teeth, enabling precise segmentation of individual teeth in panoramic X-ray images. We validate the feasibility of our approach using a challenging dataset. By training our segmentation network on 115 panoramic X-ray images, we achieve an intersection over union (IoU) of 86.56% for tooth segmentation and an accuracy of 65.52% in tooth counting on 87 test set images. Experimental results demonstrate the significant improvement of our proposed method in single tooth segmentation compared to existing methods.
References
[1]
Chen, H., Zhang, K., Lyu, P., Li, H., Zhang, L., Wu, J., et al. (2019) A Deep Learning Approach to Automatic Teeth Detection and Numbering Based on Object Detection in Dental Periapical Films. Scientific Reports, 9, Article No. 3840. https://doi.org/10.1038/s41598-019-40414-y
[2]
Shen, D., Wu, G. and Suk, H. (2017) Deep Learning in Medical Image Analysis. Annual Review of Biomedical Engineering, 19, 221-248. https://doi.org/10.1146/annurev-bioeng-071516-044442
[3]
Liu, L., Xu, J., Huan, Y., Zou, Z., Yeh, S. and Zheng, L. (2020) A Smart Dental Health-Iot Platform Based on Intelligent Hardware, Deep Learning, and Mobile Terminal. IEEE Journal of Biomedical and Health Informatics, 24, 898-906. https://doi.org/10.1109/jbhi.2019.2919916
[4]
Lurie, A., Tosoni, G.M., Tsimikas, J. and Walker, F. (2012) Recursive Hierarchic Segmentation Analysis of Bone Mineral Density Changes on Digital Panoramic Images. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology, 113, 549-558.e1. https://doi.org/10.1016/j.oooo.2011.10.002
[5]
Indraswari, R., Arifin, A.Z., Navastara, D.A. and Jawas, N. (2015). Teeth Segmentation on Dental Panoramic Radiographs Using Decimation-Free Directional Filter Bank Thresholding and Multistage Adaptive Thresholding. 2015 International Conference on Information & Communication Technology and Systems (ICTS), Surabaya, 16 September 2015, 49-54. https://doi.org/10.1109/icts.2015.7379870
[6]
Alsmadi, M.K. (2018) A Hybrid Fuzzy C-Means and Neutrosophic for Jaw Lesions Segmentation. Ain Shams Engineering Journal, 9, 697-706. https://doi.org/10.1016/j.asej.2016.03.016
[7]
Ali, R.B., Ejbali, R. and Zaied, M. (2015) GPU-Based Segmentation of Dental X-Ray Images Using Active Contours without Edges. 15th International Conference on Intelligent Systems Design and Applications, Marrakech, 14-16 December 2015, 505-510.
[8]
Li, H., Sun, G., Sun, H. and Liu, W. (2012) Watershed Algorithm Based on Morphology for Dental X-Ray Images Segmentation. IEEE 11th International Conference on Signal Processing, Vol. 2, 877-880.
[9]
Krois, J., Ekert, T., Meinhold, L., Golla, T., Kharbot, B., Wittemeier, A., et al. (2019) Deep Learning for the Radiographic Detection of Periodontal Bone Loss. Scientific Reports, 9, Article No. 8495. https://doi.org/10.1038/s41598-019-44839-3
[10]
Silva, G., Oliveira, L. and Pithon, M. (2018) Automatic Segmenting Teeth in X-Ray Images: Trends, a Novel Data Set, Benchmarking and Future Perspectives. Expert Systems with Applications,107, 15-31. https://doi.org/10.1016/j.eswa.2018.04.001
Nishitani, Y., Nakayama, R., Hayashi, D., Hizukuri, A. and Murata, K. (2021) Segmentation of Teeth in Panoramic Dental X-Ray Images Using U-Net with a Loss Function Weighted on the Tooth Edge. Radiological Physics and Technology, 14, 64-69. https://doi.org/10.1007/s12194-020-00603-1
[13]
Koch, T.L., Perslev, M., Igel, C. and Brandt, S.S. (2019) Accurate Segmentation of Dental Panoramic Radiographs with U-Nets. 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Venice, 8-11 April 2019, 15-19. https://doi.org/10.1109/isbi.2019.8759563
[14]
Jader, G., Fontineli, J., Ruiz, M., Abdalla, K., Pithon, M. and Oliveira, L. (2018) Deep Instance Segmentation of Teeth in Panoramic X-Ray Images. 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Paraná, 29 October-1 November 2018, 400-407. https://doi.org/10.1109/sibgrapi.2018.00058
[15]
He, K., Gkioxari, G., Dollar, P. and Girshick, R. (2017) Mask R-CNN. 2017 IEEE International Conference on Computer Vision (ICCV), Venice, 22-29 October 2017, 2961-2969. https://doi.org/10.1109/iccv.2017.322
[16]
Silva, B., Pinheiro, L., Oliveira, L. and Pithon, M. (2020) A Study on Tooth Segmentation and Numbering Using End-to-End Deep Neural Networks. 33rd SIBGRAPI Conference on Graphics, Patterns and Images, Recife/Porto de Galinhas, 7-10 November 2020, 164-171.
[17]
Liu, S., Qi, L., Qin, H., Shi, J. and Jia, J. (2018) Path Aggregation Network for Instance Segmentation. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 8759-8768. https://doi.org/10.1109/cvpr.2018.00913
[18]
Chen, K., Ouyang, W., Loy, C.C., Lin, D., Pang, J., Wang, J., et al. (2019) Hybrid Task Cascade for Instance Segmentation. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 15-20 June 2019, 4974-4983. https://doi.org/10.1109/cvpr.2019.00511
[19]
Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., et al. (2022) Resnest: Split-Attention Networks. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), New Orleans, 18-24 June 2022, 2736-2746. https://doi.org/10.1109/cvprw56347.2022.00309
[20]
Helli, S. and Hamamci, A. (2022) Tooth Instance Segmentation on Panoramic Dental Radiographs Using U-Nets and Morphological Processing. Düzce University Journal of Science & Technology, 10, 39-50.
[21]
Ronneberger, O., Fischer, P. and Brox, T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. 2015 Medical Image Computing and Computer-Assisted Intervention, Munich, 5-9 October 2015, 234-241.
[22]
Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y. and Kainz, B. (2018) Attention U-Net: Learning Where to Look for the Pancreas. 1st Conference on Medical Imaging with Deep Learning, Amsterdam, 4-6 July 2018, 1-10.
[23]
Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N. and Liang, J. (2018) Unet++: A Nested U-Net Architecture for Medical Image Segmentation. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Vol. 4, 3-11.
[24]
Ke, L., Tai, Y. and Tang, C. (2021) Deep Occlusion-Aware Instance Segmentation with Overlapping Bilayers. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, 20-25 June 2021, 4019-4028. https://doi.org/10.1109/cvpr46437.2021.00401
[25]
Abdi, A.H., Kasaei, S. and Mehdizadeh, M. (2015) Automatic Segmentation of Mandible in Panoramic X-Ray. Journal of Medical Imaging, 2, Article ID: 044003. https://doi.org/10.1117/1.jmi.2.4.044003
