How Adequately is the Severity of Atopic Dermatitis Assessed by Resident Physicians Training in Dermatology? Evaluation of the Intrarater and Interrater Reliability of Clinical Scoring Systems (EASI, oSCORAD, IGA, TIS Score, SASSAD)
DOI:
https://doi.org/10.2340/actadv.v106.43964Keywords:
atopic dermatitis, eczema, reliability, reproducibility of resultsAbstract
Various scoring systems for atopic dermatitis assess different aspects of the disease, but the supporting data on their validation and reliability are often limited. To ensure accurate interpretations, it is essential to conduct thorough reliability and agreement testing. This study aimed to evaluate the reliability and reproducibility of 5 atopic dermatitis assessment tools – Eczema Area and Severity Index (EASI), objective Scoring Atopic Dermatitis Index (oSCORAD), validated Investigator Global Assessment for Atopic Dermatitis (vIGA-AD), Three Item Severity (TIS) score, and Six-Area, Six-Sign Atopic Dermatitis (SASSAD) severity score – among trained dermatology residents. Thirteen patients were assessed twice by 11 raters using each scoring system. Intrarater and interrater reliability were evaluated. EASI demonstrated the highest interrater reliability (ICC = 0.768 and 0.796); SASSAD and oSCORAD followed closely (ICC = 0.741 and 0.772; ICC = 0.723 and 0.709, respectively). The TIS (ICC=0.553 and 0.584) and IGA (Kendall’s W=0.273 and 0.315) exhibited the lowest reliability. Given the generally higher reliability in this study compared with previous research, implementing standardized training on atopic dermatitis scoring systems early in the education of resident physicians may improve the reliability of these tools, equipping future dermatologists to perform effectively in clinical trials and drug programmes.
Downloads
References
Kim J, Kim BE, Leung DYM. Pathophysiology of atopic -dermatitis: clinical implications. Allergy Asthma Proc 2019; 40: 84–92. DOI: https://doi.org/10.2500/aap.2019.40.4202
Raimondo A, Lembo S. Atopic dermatitis: epidemiology and clinical phenotypes. Dermatol Pract Concept 2021; e2021146. DOI: https://doi.org/10.5826/dpc.1104a146
Hanifin JM, Rajka G. Diagnostic features of atopic dermatitis. Acta Derm Venereol 1980; 60: 44–47. DOI: https://doi.org/10.2340/00015555924447
Eichenfield LF, Hanifin JM, Luger TA, Stevens SR, Pride HB. Consensus conference on pediatric atopic dermatitis. J Am Acad Dermatol 2003; 49: 1088–1095. DOI: https://doi.org/10.1016/S0190-9622(03)02539-8
Yang YB, Lynde CW, Fleming P. Common atopic -dermatitis rating scales: a practical approach and brief review. J Cutan Med Surg 2020; 24: 399–404. DOI: https://doi.org/10.1177/1203475420923644
Bożek A, Reich A. Assessment of the severity of atopic dermatitis. Dermatol Rev 2016; 6: 479–485. DOI: https://doi.org/10.5114/dr.2016.63839
Schmitt J, Langan S, Deckert S, Svensson A, von Kobyletzki L, Thomas K, et al. Assessment of clinical signs of atopic dermatitis: a systematic review and recommendation. J Allergy Clin Immunol 2013; 132: 1337–1347. DOI: https://doi.org/10.1016/j.jaci.2013.07.008
Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol 2011; 64: 96–106. DOI: https://doi.org/10.1016/j.jclinepi.2010.03.002
Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using Lme4. J Stat Softw 2015; 67: 1–48. doi:10.18637/jss.v067.i01 DOI: https://doi.org/10.18637/jss.v067.i01
R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2024 [accessed February 7, 2025]. Available from: https://www.r-project.org/
Posit Team. RStudio: Integrated Development Environment for R. Boston, MA: Posit Software, PBC; 2024 [accessed February 7, 2025]. Available from: http://www.posit.co/
Christensen R. Ordinal-regression models for ordinal data. R Package Version 2023.12-4.1 [accessed February 7, 2025]. Available from: https://CRAN.r-project.org/package=ordinal
Lenth R. Emmeans: estimated marginal means, aka least-squares means. R Package Version 1.10.6 [accessed February 7, 2025]. Available from: https://CRAN.r-project.org/package=emmeans
Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 1994; 6: 284–290. DOI: https://doi.org/10.1037/1040-3590.6.4.284
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016; 15: 155–163. DOI: https://doi.org/10.1016/j.jcm.2016.02.012
Simpson E, Bissonnette R, Eichenfield LF, Guttman-Yassky E, King B, Silverberg JI, et al. The validated investigator global assessment for atopic dermatitis (VIGA-AD): the development and reliability testing of a novel clinical outcome measurement instrument for the severity of atopic dermatitis. J Am Acad Dermatol 2020; 83: 839–846. DOI: https://doi.org/10.1016/j.jaad.2020.04.104
McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 2012; 22: 276–282. DOI: https://doi.org/10.11613/BM.2012.031
Schmitt J, Spuls PI, Thomas KS, Simpson E, Furue M, Deckert S, et al. The Harmonising Outcome Measures for Eczema (HOME) statement to assess clinical signs of atopic eczema in trials. J Allergy Clin Immunol 2014; 134: 800–807. DOI: https://doi.org/10.1016/j.jaci.2014.07.043
Oranje AP. Practical issues on interpretation of scoring atopic dermatitis: SCORAD index, objective SCORAD, patient-oriented SCORAD and three-item severity score. Curr Probl Dermatol 2011; 41: 149–155. DOI: https://doi.org/10.1159/000323308
Zhao CY, Tran AQT, Lazo-Dizon JP, Kim J, Daniel BS, Venugopal SS, et al. A pilot comparison study of four clinician-rated atopic dermatitis severity scales. Br J Dermatol 2015; 173: 488–497. DOI: https://doi.org/10.1111/bjd.13846
Carel K, Bratton DL, Miyazawa N, Gyorkos E, Kelsay K, Bender B, et al. The Atopic Dermatitis Quickscore (ADQ): validation of a new parent-administered atopic dermatitis scoring tool. Ann Allergy Asthma Immunol 2008; 101: 500–507. DOI: https://doi.org/10.1016/S1081-1206(10)60289-X
Charman CR, Venn AJ, Williams H, Bigby M. Measuring atopic eczema severity visually. Arch Dermatol 2005; 141. DOI: https://doi.org/10.1001/archderm.141.9.1146
Hanifin JM, Thurston M, Omoto M, Cherill R, Tofte SJ, Graeber M, et al. The Eczema Area and Severity Index (EASI): assessment of reliability in atopic dermatitis. Exp Dermatol 2001; 10: 11–18. DOI: https://doi.org/10.1034/j.1600-0625.2001.100102.x
Bożek A, Reich A. Assessment of intra- and inter-rater reliability of three methods for measuring atopic dermatitis severity: EASI, objective SCORAD, and IGA. Dermatology 2017; 233: 16–22. DOI: https://doi.org/10.1159/000472711
Davis CM, Flohr C, Gupta MR, Koplin JJ. Managing atopic dermatitis in patients with skin of color. J Allergy Clin Immunol Pract 2023; 11: 1376–1383. DOI: https://doi.org/10.1016/j.jaip.2023.03.041
Additional Files
Published
How to Cite
License
Copyright (c) 2026 Katarzyna Waligóra-Dziwak, Katarzyna B. Kubiak, Aleksandra Dańczak-Pazdrowska, Dorota Jenerowicz
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
All digitalized ActaDV contents is available freely online. The Society for Publication of Acta Dermato-Venereologica owns the copyright for all material published until volume 88 (2008) and as from volume 89 (2009) the journal has been published fully Open Access, meaning the authors retain copyright to their work.
Unless otherwise specified, all Open Access articles are published under CC-BY-NC licences, allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for non-commercial purposes, provided proper attribution to the original work.
