Validated prediction of xerostomia in a real-world population: a step toward model-guided radiotherapy
DOI:
https://doi.org/10.2340/1651-226X.2025.43462Keywords:
external validation, Xerostomia, Head and neck cancer, dose- response relationship, normal tissue complication probability, radiation therapyAbstract
Background and purpose: The aim of this study is to validate an Normal Tissue Complication Probability (NTCP) model for xerostomia in a large quality-registry cohort, enabling its future use in individualized NTCP-based treatment planning.
Material and methods: A model predicting grade ≥ 2 xerostomia (6 months post-radiotherapy) was selected for validation, including the mean dose to both the parotid and the submandibular glands, in addition to the baseline score for xerostomia, as predictors. Our local validation cohort consisted of 674 patients (204 events), treated between 2012 and 2024, with a median follow-up of 10.3 months (range 5–24). A closed testing procedure was performed to investigate the need for model updating, and the performance of the models was assessed with calibration curves, discrimination, the Brier score, and the Hosmer-Lemeshow test.
Results: The calibration curve demonstrated that the model predicted the dose–response relationship well. The validation cohort showed a slightly stronger dose response, with a slope of 1.16. The calibration intercept of −0.12 revealed an overestimation of xerostomia.
However, the closed testing procedure indicated that a recalibration of the model was needed, and the HL-test showed a significant deviation. The recalibrated model showed perfect calibration but still limited discrimination (Area Under the Curve (AUC) 0.62).
Conclusion: The validated model performed well in our real-life dataset despite the differences between the training and validation cohorts, particularly considering the lack of baseline score in our cohort. This highlights the potential for improved performance with baseline inclusion but still suggests that an individualized NTCP-based treatment-planning protocol can be developed using the recalibrated published model.
Downloads
References
Langendijk JA, Doornaert P, Verdonck-de Leeuw IM, Leemans CR, Aaronson NK, Slotman BJ. Impact of late treatment-related toxicity on quality of life among patients with head and neck cancer treated with radiotherapy. J Clin Oncol. 2008;26(22):3770–6.
https://doi.org/10.1200/jco.2007.14.6647 DOI: https://doi.org/10.1200/JCO.2007.14.6647
Van den Bosch L, van der Schaaf A, van der Laan HP, Hoebers FJP, Wijers OB, van den Hoek JGM, et al. Comprehensive toxicity risk profiling in radiation therapy for head and neck cancer: a new concept for individually optimised treatment. Radiother Oncol. 2021;157:147–54.
https://doi.org/10.1016/j.radonc.2021.01.024 DOI: https://doi.org/10.1016/j.radonc.2021.01.024
Beetz I, Schilstra C, van der Schaaf A, van den Heuvel ER, Doornaert P, van Luijk P, et al. NTCP models for patient-rated xerostomia and sticky saliva after treatment with intensity modulated radiotherapy for head and neck cancer: the role of dosimetric and clinical factors. Radiother Oncol. 2012;105(1):101–6.
https://doi.org/10.1016/j.radonc.2012.03.004 DOI: https://doi.org/10.1016/j.radonc.2012.03.004
Onjukka E, Mercke C, Björgvinsson E, Embring A, Berglund A, Alexandersson von Döbeln G, et al. Modeling of xerostomia after radiotherapy for head and neck cancer: a registry study. Front Oncol. 2020;10:1647.
https://doi.org/10.3389/fonc.2020.01647 DOI: https://doi.org/10.3389/fonc.2020.01647
Lee TF, Liou MH, Huang YJ, Chao PJ, Ting HM, Lee HY, et al. LASSO NTCP predictors for the incidence of xerostomia in patients with head and neck squamous cell carcinoma and nasopharyngeal carcinoma. Sci Rep. 2014;4:6217.
https://doi.org/10.1038/srep06217 DOI: https://doi.org/10.1038/srep06217
Beetz I, Steenbakkers RJ, Chouvalova O, Leemans CR, Doornaert P, van der Laan BF, et al. The QUANTEC criteria for parotid gland dose and their efficacy to prevent moderate to severe patient-rated xerostomia. Acta Oncol. 2014;53(5):597–604.
https://doi.org/10.3109/0284186x.2013.831186 DOI: https://doi.org/10.3109/0284186X.2013.831186
Lee TF, Fang FM. Quantitative analysis of normal tissue effects in the clinic (QUANTEC) guideline validation using quality of life questionnaire datasets for parotid gland constraints to avoid causing xerostomia during head-and-neck radiotherapy. Radiother Oncol. 2013;106(3):352–8.
https://doi.org/10.1016/j.radonc.2012.11.013 DOI: https://doi.org/10.1016/j.radonc.2012.11.013
Gabryś HS, Buettner F, Sterzing F, Hauswald H, Bangert M. Parotid gland mean dose as a xerostomia predictor in low-dose domains. Acta Oncol. 2017;56(9):1197–203.
https://doi.org/10.1080/0284186x.2017.1324209 DOI: https://doi.org/10.1080/0284186X.2017.1324209
Hawkins PG, Lee JY, Mao Y, Li P, Green M, Worden FP, et al. Sparing all salivary glands with IMRT for head and neck cancer: longitudinal study of patient-reported xerostomia and head-and-neck quality of life. Radiother Oncol. 2018;126(1):68–74.
https://doi.org/10.1016/j.radonc.2017.08.002 DOI: https://doi.org/10.1016/j.radonc.2017.08.002
Buettner F, Miah AB, Gulliford SL, Hall E, Harrington KJ, Webb S, et al. Novel approaches to improve the therapeutic index of head and neck radiotherapy: an analysis of data from the PARSPORT randomised phase III trial. Radiother Oncol. 2012;103(1):82–7.
https://doi.org/10.1016/j.radonc.2012.02.006 DOI: https://doi.org/10.1016/j.radonc.2012.02.006
van Dijk LV, Noordzij W, Brouwer CL, Boellaard R, Burgerhof JGM, Langendijk JA, et al. (18)F-FDG PET image biomarkers improve prediction of late radiation-induced xerostomia. Radiother Oncol. 2018;126(1):89–95.
https://doi.org/10.1016/j.radonc.2017.08.024 DOI: https://doi.org/10.1016/j.radonc.2017.08.024
van Rijn-Dekker MI, van Luijk P, Schuit E, van der Schaaf A, Langendijk JA, Steenbakkers R. Prediction of radiation-induced parotid gland-related xerostomia in patients with head and neck cancer: regeneration-weighted dose. Int J Radiat Oncol Biol Phys. 2023;117(3):750–62.
https://doi.org/10.1016/j.ijrobp.2023.04.034 DOI: https://doi.org/10.1016/j.ijrobp.2023.04.034
Steenbakkers R, van Rijn-Dekker MI, Stokman MA, Kierkels RGJ, van der Schaaf A, van den Hoek JGM, et al. Parotid gland stem cell sparing radiation therapy for patients with head and neck cancer: a double-blind randomized controlled trial. Int J Radiat Oncol Biol Phys. 2022;112(2):306–16.
https://doi.org/10.1016/j.ijrobp.2021.09.023 DOI: https://doi.org/10.1016/j.ijrobp.2021.09.023
Astaburuaga R, Gabryś HS, Sánchez-Nieto B, Floca RO, Klüter S, Schubert K, et al. Incorporation of dosimetric gradients and parotid gland migration into xerostomia prediction. Front Oncol. 2019;9:697.
https://doi.org/10.3389/fonc.2019.00697 DOI: https://doi.org/10.3389/fonc.2019.00697
ICRU. Prescribing, recording, and Reporting Photon-Bean Intensity-Modulated Radiation Therapy (IMRT). ICRU Report 83. J ICRU. 2010;10:27. DOI: https://doi.org/10.1093/jicru/10.1.Report83
Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Bmj. 2015;350:g7594.
https://doi.org/10.1136/bmj.g7594 DOI: https://doi.org/10.1136/bmj.g7594
Sharabiani M, Clementel E, Andratschke N, Hurkmans C. Generalizability assessment of head and neck cancer NTCP models based on the TRIPOD criteria. Radiother Oncol. 2020;146:143–50.
https://doi.org/10.1016/j.radonc.2020.02.013 DOI: https://doi.org/10.1016/j.radonc.2020.02.013
Ramspek CL, Jager KJ, Dekker FW, Zoccali C, van Diepen M. External validation of prognostic models: what, why, how, when and where? Clin Kidney J. 2021;14(1):49–58.
https://doi.org/10.1093/ckj/sfaa188 DOI: https://doi.org/10.1093/ckj/sfaa188
Binuya MAE, Engelhardt EG, Schats W, Schmidt MK, Steyerberg EW. Methodological guidance for the evaluation and updating of clinical prediction models: a systematic review. BMC Med Res Methodol. 2022;22(1):316.
https://doi.org/10.1186/s12874-022-01801-8 DOI: https://doi.org/10.1186/s12874-022-01801-8
Moons KG, Kengne AP, Grobbee DE, Royston P, Vergouwe Y, Altman DG, et al. Risk prediction models: II. External validation, model updating, and impact assessment. Heart. 2012;98(9):691–8.
https://doi.org/10.1136/heartjnl-2011-301247 DOI: https://doi.org/10.1136/heartjnl-2011-301247
Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW. Calibration: the Achilles heel of predictive analytics. BMC Med. 2019;17(1):230.
https://doi.org/10.1186/s12916-019-1466-7 DOI: https://doi.org/10.1186/s12916-019-1466-7
Riley RD, Archer L, Snell KIE, Ensor J, Dhiman P, Martin GP, et al. Evaluation of clinical prediction models (part 2): how to undertake an external validation study. BMJ. 2024;384:e074820.
https://doi.org/10.1136/bmj-2023-074820 DOI: https://doi.org/10.1136/bmj-2023-074820
Landelijk Platform Protonentherapie (LPPT). Landelijk Indicatieprotocol Protonentherapie Hoofdhals. (v 2.2). 2017. Available from: http://www.nvro.nl/publicaties/rapporten [Cited date: 2024 Dec 9]
Langendijk JA, Lambin P, De Ruysscher D, Widder J, Bos M, Verheij M. Selection of patients for radiotherapy with protons aiming at reduction of side effects: the model-based approach. Radiother Oncol. 2013;107(3):267-73. https://doi.org/10.1016/j.radonc.2013.05.007 DOI: https://doi.org/10.1016/j.radonc.2013.05.007
Grégoire V, Evans M, Le QT, Bourhis J, Budach V, Chen A, et al. Delineation of the primary tumour Clinical Target Volumes (CTV-P) in laryngeal, hypopharyngeal, oropharyngeal and oral cavity squamous cell carcinoma: AIRO, CACA, DAHANCA, EORTC, GEORCC, GORTEC, HKNPCSG, HNCIG, IAG-KHT, LPRHHT, NCIC CTG, NCRI, NRG Oncology, PHNS, SBRT, SOMERA, SRO, SSHNO, TROG consensus guidelines. Radiother Oncol. 2018;126(1):3–24.
https://doi.org/10.1016/j.radonc.2017.10.016 DOI: https://doi.org/10.1016/j.radonc.2017.10.016
Cox JD, Stetz J, Pajak TF. Toxicity criteria of the Radiation Therapy Oncology Group (RTOG) and the European Organization for Research and Treatment of Cancer (EORTC). Int J Radiat Oncol Biol Phys. 1995;31(5):1341–6.
https://doi.org/10.1016/0360-3016(95)00060-c DOI: https://doi.org/10.1016/0360-3016(95)00060-C
Vergouwe Y, Nieboer D, Oostenbrink R, Debray TPA, Murray GD, Kattan MW, et al. A closed testing procedure to select an appropriate method for updating prediction models. Stat Med. 2017;36(28):4529–39.
https://doi.org/10.1002/sim.7179 DOI: https://doi.org/10.1002/sim.7179
Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak. 2008;8:53.
https://doi.org/10.1186/1472-6947-8-53 DOI: https://doi.org/10.1186/1472-6947-8-53
Steyerberg EW. Clinical prediction models – a practical approach to development, validation, and updating. Springer, New York; 2009.
Iacovacci J, Palorini F, Cicchetti A, Fiorino C, Rancati T. Dependence of the AUC of NTCP models on the observational dose-range highlights cautions in comparison of discriminative performance. Phys Med. 2023;113:102654.
https://doi.org/10.1016/j.ejmp.2023.102654 DOI: https://doi.org/10.1016/j.ejmp.2023.102654
Li Y, Taylor JM, Ten Haken RK, Eisbruch A. The impact of dose on parotid salivary recovery in head and neck cancer patients treated with radiation therapy. Int J Radiat Oncol Biol Phys. 2007;67(3):660–9.
https://doi.org/10.1016/j.ijrobp.2006.09.021 DOI: https://doi.org/10.1016/j.ijrobp.2006.09.021
Nakatsugawa M, Cheng Z, Kiess A, Choflet A, Bowers M, Utsunomiya K, et al. The needs and benefits of continuous model updates on the accuracy of RT-induced toxicity prediction models within a learning health system. Int J Radiat Oncol Biol Phys. 2019;103(2):460–7.
https://doi.org/10.1016/j.ijrobp.2018.09.038 DOI: https://doi.org/10.1016/j.ijrobp.2018.09.038
Eisbruch A, Kim HM, Terrell JE, Marsh LH, Dawson LA, Ship JA. Xerostomia and its predictors following parotid-sparing irradiation of head-and-neck cancer. Int J Radiat Oncol Biol Phys. 2001;50(3):695–704.
https://doi.org/10.1016/s0360-3016(01)01512-7 DOI: https://doi.org/10.1016/S0360-3016(01)01512-7
van Rijn-Dekker MI, la Bastide-van Gemert S, Stokman MA, Vissink A, Coppes RP, Langendijk JA, et al. Radiation-induced xerostomia is related to stem cell dose-dependent reduction of saliva production. Int J Radiat Oncol Biol Phys. 2024;120(3):772–82.
https://doi.org/10.1016/j.ijrobp.2024.04.012 DOI: https://doi.org/10.1016/j.ijrobp.2024.04.012
Chu H, de Vette SPM, Neh H, Sijtsema NM, Steenbakkers R, Moreno A, et al. Three-dimensional deep learning normal tissue complication probability model to predict late xerostomia in patients with head and neck cancer. Int J Radiat Oncol Biol Phys. 2025;121(1):269–80.
https://doi.org/10.1016/j.ijrobp.2024.07.2334 DOI: https://doi.org/10.1016/j.ijrobp.2024.07.2334
de Vette SPM, van Rijn-Dekker MI, Van den Bosch L, Keijzer K, Neh H, Chu H, et al. Evaluation of a comprehensive set of normal tissue complication probability models for patients with head and neck cancer in an international cohort. Oral Oncol. 2025;163:107224.
https://doi.org/10.1016/j.oraloncology.2025.107224 DOI: https://doi.org/10.1016/j.oraloncology.2025.107224
Additional Files
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2025 Emmy Dalqvist, Tiziana Rancati, Anna Embring, Gabriella Alexandersson von Döbeln, Ingmar Lax, Signe Friesland, Eva Onjukka
This work is licensed under a Creative Commons Attribution 4.0 International License.
