Assessing ChatGPT-4’s Capabilities in Generating Dermatology Board Examination Content: An Explorational Study

Authors

  • Jonathan Shapiro Maccabi Healthcare Services, Tel Aviv-Yafo, Israel
  • Anna Lyakhovitsky Department of Dermatology, Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel; School of Medicine, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel
  • Tamar Freud Ben-Gurion University of the Negev, Beer-Sheva, Israel
  • Felix Pavlotsky Department of Dermatology, Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel; School of Medicine, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel
  • Ziyad Khamaysi Department of Dermatology, Rambam Health Care Campus, Haifa, Israel; Technion Faculty of Medicine, Haifa, Israel
  • Yulia Valdman-Grinshpoun Soroka Medical University Center, Beer-Sheva, Israel
  • Roni Dodiuk-Gad Department of Dermatology, Emek Medical Center, Afula, Israel; Technion Faculty of Medicine, Haifa, Israel; Division of Dermatology, Department of Medicine, University of Toronto, Canada
  • Ilan Goldberg Division of Dermatology, Tel-Aviv Sourasky Medical Center, Tel-Aviv, Israel; School of Medicine, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel,
  • Arieh Ingber Hadassah medical center, Jerusalem, Israel
  • Baruch Kaplan Adelson School of Medicine, Ariel university, Ariel, Israel
  • Emily Avitan-Hersh Department of Dermatology, Rambam Health Care Campus, Haifa, Israel; Technion Faculty of Medicine, Haifa, Israel

DOI:

https://doi.org/10.2340/actadv.v105.41208

Keywords:

artificial intelligence, specialty boards, knowledge management

Downloads

Download data is not yet available.

References

Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare (Basel) 2023; 11: 887.

https://doi.org/10.3390/healthcare11060887 DOI: https://doi.org/10.3390/healthcare11060887

Joly-Chevrier M, Nguyen AXL, Lesko-Krleza M, Lefrançois P. Performance of ChatGPT on a practice Dermatology Board certification examination. J Cutan Med Surg 2023; 27: 407-409.

https://doi.org/10.1177/12034754231188437 DOI: https://doi.org/10.1177/12034754231188437

Eysenbach G. The role of ChatGPT, generative language models, and artificial intelligence in medical education: a conversation with ChatGPT and a call for papers. JMIR Med Educ 2023; 9: e46885.

https://doi.org/10.2196/46885 DOI: https://doi.org/10.2196/46885

Lee H. The rise of ChatGPT: exploring its potential in medical education. Anat Sci Educ 2024; 17: 926-931.

https://doi.org/10.1002/ase.2270 DOI: https://doi.org/10.1002/ase.2270

Ayub I, Hamann D, Hamann CR, Davis MJ. Exploring the potential and limitations of Chat Generative Pre-trained Transformer (ChatGPT) in generating board-style dermatology questions: a qualitative analysis. Cureus 2023; 15: e43717.

https://doi.org/10.7759/cureus.43717 DOI: https://doi.org/10.7759/cureus.43717

Bolognia JL, Schaffer JV, Cerroni L. Dermatology, 4th edition. London?Hoboken, NJ: Elsevier, 2017.

Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C, et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health 2023; 2: e0000198.

https://doi.org/10.1371/journal.pdig.0000198 DOI: https://doi.org/10.1371/journal.pdig.0000198

Barbour AB, Barbour TA. A radiation oncology board exam of ChatGPT. Cureus 2023; 15: e44541.

https://doi.org/10.7759/cureus.44541 DOI: https://doi.org/10.7759/cureus.44541

Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor RA, et al. How does ChatGPT perform on the United States Medical Licensing Examination (USMLE)? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ 2023; 9: e45312.

https://doi.org/10.2196/45312 DOI: https://doi.org/10.2196/45312

Passby L, Jenko N, Wernham A. Performance of ChatGPT on Specialty Certificate Examination in Dermatology multiple-choice questions. Clin Exp Dermatol 2024; 49: 722-727.

https://doi.org/10.1093/ced/llad197 DOI: https://doi.org/10.1093/ced/llad197

Downloads

Additional Files

Published

2025-01-03

How to Cite

Shapiro, J., Lyakhovitsky, A., Freud, T., Pavlotsky, F., Khamaysi, Z., Valdman-Grinshpoun, Y. ., … Avitan-Hersh, E. (2025). Assessing ChatGPT-4’s Capabilities in Generating Dermatology Board Examination Content: An Explorational Study. Acta Dermato-Venereologica, 105, adv41208. https://doi.org/10.2340/actadv.v105.41208

Issue

Vol. 105 (2025)

Section

Short Communication

Categories

License

Copyright (c) 2025 Jonathan Shapiro, Anna Lyakhovitsky, Tamar Freud, Felix Pavlotsky, Ziyad Khamaysi, Yulia Valdman-Grinshpoun, Roni Dodiuk-Gad, Ilan Goldberg, Arieh Ingber, Baruch Kaplan, Emily Avitan-Hersh

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

All digitalized ActaDV contents is available freely online. The Society for Publication of Acta Dermato-Venereologica owns the copyright for all material published until volume 88 (2008) and as from volume 89 (2009) the journal has been published fully Open Access, meaning the authors retain copyright to their work.

Unless otherwise specified, all Open Access articles are published under CC-BY-NC licences, allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for non-commercial purposes, provided proper attribution to the original work.

Crossref
Scopus
Google Scholar
Europe PMC