Comparison of the use of a clinically implemented deep learning segmentation model with the simulated study setting for breast cancer patients receiving radiotherapy
DOI:
https://doi.org/10.2340/1651-226X.2024.34986Keywords:
Deep Learning, Breast cancer, Auto-segmentation, ClinicalAbstract
Background: Deep learning (DL) models for auto-segmentation in radiotherapy have been extensively studied in retrospective and pilot settings. However, these studies might not reflect the clinical setting. This study compares the use of a clinically implemented in-house trained DL segmentation model for breast cancer to a previously performed pilot study to assess possible differences in performance or acceptability.
Material and methods: Sixty patients with whole breast radiotherapy, with or without an indication for locoregional radiotherapy were included. Structures were qualitatively scored by radiotherapy technologists and radiation oncologists. Quantitative evaluation was performed using dice-similarity coefficient (DSC), 95th percentile of Hausdorff Distance (95%HD) and surface DSC (sDSC), and time needed for generating, checking, and correcting structures was measured.
Results: Ninety-three percent of all contours in clinic were scored as clinically acceptable or usable as a starting point, comparable to 92% achieved in the pilot study. Compared to the pilot study, no significant changes in time reduction were achieved for organs at risks (OARs). For target volumes, significantly more time was needed compared to the pilot study for patients including lymph node levels 1–4, although time reduction was still 33% compared to manual segmentation. Almost all contours have better DSC and 95%HD than inter-observer variations. Only CTVn4 scored worse for both metrics, and the thyroid had a higher 95%HD value.
Interpretation: The use of the DL model in clinical practice is comparable to the pilot study, showing high acceptability rates and time reduction.
Downloads
References
Li XA, Tai A, Arthur DW, Buchholz TA, Macdonald S, Marks LB, et al. Variability of target and normal structure delineation for breast cancer radiotherapy: an RTOG multi-institutional and multiobserver study. Int J Radiat Oncol Biol Phys. 2009;73:944–51.
https://doi.org/10.1016/j.ijrobp.2008.10.034 DOI: https://doi.org/10.1016/j.ijrobp.2008.10.034
Ciardo D, Argenone A, Boboc GI, Cucciarelli F, De Rose F, De Santis MC, et al. Variability in axillary lymph node delineation for breast cancer radiotherapy in presence of guidelines on a multi-institutional platform. Acta Oncol (Madr). 2017;56:1081–8.
https://doi.org/10.1080/0284186X.2017.1325004 DOI: https://doi.org/10.1080/0284186X.2017.1325004
Eldesoky AR, Yates ES, Nyeng TB, Thomsen MS, Nielsen HM, Poortmans P, et al. Internal and external validation of an ESTRO delineation guideline – dependent automated segmentation tool for loco-regional radiation therapy of early breast cancer. Radiother Oncol. 2016;121:424–30.
https://doi.org/10.1016/j.radonc.2016.09.005 DOI: https://doi.org/10.1016/j.radonc.2016.09.005
Ciardo D, Gerardi MA, Vigorito S, Morra A, Dell’acqua V, Diaz FJ, et al. Atlas-based segmentation in breast cancer radiotherapy: evaluation of specific and generic-purpose atlases. Breast. 2017;32:44–52.
https://doi.org/10.1016/j.breast.2016.12.010 DOI: https://doi.org/10.1016/j.breast.2016.12.010
Men K, Zhang T, Chen X, Chen B, Tang Y, Wang S, et al. Fully automatic and robust segmentation of the clinical target volume for radiotherapy of breast cancer using big data and deep learning. Phys Med. 2018;50:13–9.
https://doi.org/10.1016/j.ejmp.2018.05.006 DOI: https://doi.org/10.1016/j.ejmp.2018.05.006
Choi MS, Choi BS, Chung SY, Kim N, Chun J, Kim YB, et al. Clinical evaluation of atlas- and deep learning-based automatic segmentation of multiple organs and clinical target volumes for breast cancer. Radiother Oncol. 2020;153:139–45.
https://doi.org/10.1016/j.radonc.2020.09.045 DOI: https://doi.org/10.1016/j.radonc.2020.09.045
Byun HK, Chang JS, Choi MS, Chun J, Jung J, Jeong C, et al. Evaluation of deep learning-based autosegmentation in breast cancer radiotherapy. Radiat Oncol. 2021;16:1–8.
https://doi.org/10.1186/s13014-021-01923-1 DOI: https://doi.org/10.1186/s13014-021-01923-1
Liu Z, Liu F, Chen W, Tao Y, Liu X, Zhang F, et al. Automatic segmentation of clinical target volume and organs-at-risk for breast conservative radiotherapy using a convolutional neural network. Cancer Manag Res. 2021;13:8209–17.
https://doi.org/10.2147/CMAR.S330249 DOI: https://doi.org/10.2147/CMAR.S330249
Chung SY, Chang JS, Choi MS, Chang Y, Choi BS, Chun J, et al. Clinical feasibility of deep learning-based auto-segmentation of target volumes and organs-at-risk in breast cancer patients after breast-conserving surgery. Radiat Oncol. 2021;16:1–10.
https://doi.org/10.1186/s13014-021-01771-z DOI: https://doi.org/10.1186/s13014-021-01771-z
Almberg SS, Lervåg C, Frengen J, Eidem M, Abramova TM, Nordstrand CS, et al. Training, validation, and clinical implementation of a deep-learning segmentation model for radiotherapy of loco-regional breast cancer. Radiother Oncol. 2022;173:62–8.
https://doi.org/10.1016/j.radonc.2022.05.018 DOI: https://doi.org/10.1016/j.radonc.2022.05.018
McIntosh C, Conroy L, Tjong MC, Craig T, Bayley A, Catton C, et al. Clinical integration of machine learning for curative-intent radiation treatment of patients with prostate cancer. Nat Med. 2021;27:999–1005.
https://doi.org/10.1038/s41591-021-01359-w DOI: https://doi.org/10.1038/s41591-021-01359-w
Barragán-Montero A, Bibal A, Dastarac MH, Draguet C, Valdés G, Nguyen D, et al. Towards a safe and efficient clinical implementation of machine learning in radiation oncology by exploring model interpretability, explainability and data-model dependency. Phys Med Biol. 2023;67:11TR01.
https://doi.org/10.1088/1361-6560/ac678a DOI: https://doi.org/10.1088/1361-6560/ac678a
Bakx N, Rijkaart D, van der Sangen M, Theuws J, van der Toorn PP, Verrijssen AS, et al. Clinical evaluation of a deep learning segmentation model including manual adjustments afterwards for locally advanced breast cancer. Tech Innov Patient Support Radiat Oncol. 2023;26:0–5.
https://doi.org/10.1016/j.tipsro.2023.100211 DOI: https://doi.org/10.1016/j.tipsro.2023.100211
Hindocha S, Zucker K, Jena R, Banfill K, Mackay K, Price G, et al. Artificial intelligence for radiotherapy auto-contouring: Current use, perceptions of and barriers to implementation. Clin Oncol. 2023;35:219–26.
https://doi.org/10.1016/j.clon.2023.01.014 DOI: https://doi.org/10.1016/j.clon.2023.01.014
Hesso I, Kayyali R, Dolton DR, Joo K, Zacharias L, Charalambous A, et al. Cancer care at the time of the fourth industrial revolution: an insight to healthcare professionals’ perspectives on cancer care and artificial intelligence. Radiat Oncol. 2023;18:1–16.
https://doi.org/10.1186/s13014-023-02351-z DOI: https://doi.org/10.1186/s13014-023-02351-z
Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O. 3D U-net: Learning dense volumetric segmentation from sparse annotation. Med Image Comput Comput Assist Interv. 2016;9901:424–32.
https://doi.org/10.1007/978-3-319-46723-8_49 DOI: https://doi.org/10.1007/978-3-319-46723-8_49
Nikolov S, Blackwell S, Zverovitch A, Mendes R, Livne M, de Fauw J, et al. Clinically applicable segmentation of head and neck anatomy for radiotherapy: Deep learning algorithm development and validation study. J Med Internet Res. 2021;23(7):e26151.
https://doi.org/10.2196/26151 DOI: https://doi.org/10.2196/26151
Mikalsen SG, Skjøtskift T, Flote VG, Hämäläinen NP, Heydari M, Rydén-Eilertsen K. Extensive clinical testing of deep learning segmentation models for thorax and breast cancer radiotherapy planning. Acta Oncol (Madr). 2023;62:1184–93.
https://doi.org/10.1080/0284186X.2023.2270152 DOI: https://doi.org/10.1080/0284186X.2023.2270152
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2023 Nienke Bakx, Maurice van der Sangen, Jacqueline Theuws, Johanna Bluemink, Coen Hurkmans
This work is licensed under a Creative Commons Attribution 4.0 International License.
