RESEARCH ARTICLE
Nina Sabela , Lisa Olivia Ylanderb, Sandra Elizabeth Ståhlberga and Agneta Robertsona
aDepartment of Pediatric Dentistry, Institute of Odontology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden; bFolktandvården Västra Götaland, Gothenburg, Public Dental Service, Region Västra Götaland, Sweden
Objective: Experience of caries has a clearly negative impact on the quality of life in preschool children. The instrument Early Childhood Oral Health Impact Scale (ECOHIS) measures the oral health-related quality of life in preschool children (Child Impact Section) and their families (Family Impact Section). The aims of the study were to develop a Swedish version of ECOHIS and to evaluate the instrument’s reliability, validity, and internal consistency. Additionally, to analyse the oral health-related quality of life (OHRQoL) among preschool children who have experienced caries.
Methods: The original ECOHIS questionnaire was translated into Swedish. Caregivers of preschool children aged 2–5 years were recruited at dental clinics in Sweden, to participate in the study and answer the Swedish version of the ECOHIS (S-ECOHIS). The internal consistency and reliability were assessed by using Cronbach’s Alpha coefficient. In order to measure the consistency of the study, the questionnaire was re-tested two weeks later for 10 of the caregivers and assessed by using intra-class correlation coefficients (ICCs). The results from S-ECOHIS were described as descriptive data and independent t-test was performed. All data were calculated using SPSS (Statistical Package for the Social Sciences).
Results: S-ECOHIS was developed by translating the original English version using a double-blinded technique. A total of 274 caregivers participated in the study and completed the questionnaire. Cronbach’s Alpha was 0.84 for S-ECOHIS, 0.83 for CIS, and 0.66 for FIS. The ICC was 0.95 for the test-retest of S-ECOHIS. Among the respondents, 117 (43%) had children diagnosed with caries, while 157 (57%) had children without caries. The children with caries reported a higher total score of 5.97 (SD 6.16) of S-ECOHIS, compared to the score of the non-caries children 0.77 (SD 1.38) (p < 0.001).
Conclusion: The Swedish version of ECOHIS that was developed demonstrates good validity, test-retest reliability, and internal consistency. The findings show that the oral health-related quality of life is adversely affected in preschool children with caries, with particular vulnerability observed among children with untreated caries. These results indicate that S-ECOHIS is suitable for use in future clinical and research endeavors.
Abbreviations: S- ECOHIS: Swedish version of the Early Childhood Oral Health Impact Scale; OHRQoL: Oral Health-Related Quality of Life; ICC: Intraclass correlation coefficient; CIS: Children Impact Section; FIS: Family Impact Section
KEYWORDS: Early childhood oral health impact scale (ECOHIS); validation studies; preschool children; health-related quality of life; dental care for children and oral health
Citation: ACTA ODONTOLOGICA SCANDINAVICA 2024; VOL. 83: 47–53. DOI: https://doi.org/10.1080/00016357.2023.2287235.
Copyright: © 2024 The Author(s). Published by MJS Publishing on behalf of Acta Odontologica Scandinavica Society. This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material, with the condition of proper attribution to the original work.
Received: 4 July 2022; Revised: 27 October 2023; Accepted: 19 November 2023; Published: 26 March 2024.
CONTACT Nina Sabel nina.sabel@odontologi.gu.se Department of Pediatric Dentistry, Institute of Odontology, Sahlgrenska Academy, University of Gothenburg, Box 450, 405 30 Gothenburg, Sweden
Competing interests and funding: No potential conflict of interest was reported by the author(s).
Forskning och Utveckling, Halland; Health and Medical Care Committee of the Regional Executive Board, Region Västra Götaland;
Caries has a significant impact on the daily life of preschoolers. Concerns of oral health-related quality of life (OHRQoL) has led to the development of several instruments of self-reports and proxy-reports to measure the impact of oral health on daily life [1,2]. While most of the instruments are developed for adults, there are only a few specifically designed for children [3,4]. The Early Childhood Oral Health Impact Scale (ECOHIS) is an instrument to assess the OHRQoL in preschool children through proxy-report provided by their parents, based on the presence of caries [5]. Several studies show that children diagnosed with caries have a negatively affected quality of life, compared to children without caries [6,7]. Toothache resulting from caries not only causes pain and disrupts sleep in children [8,9], but it also affects the well-being of caregivers, leading to distress and guilt, which further contributes to a lower quality of life [10,11].
ECOHIS includes 13 questions with predetermined response options. While it has been published and evaluated in various languages, there is currently no valid Swedish version available. ECOHIS is parental answered and comprises nine questions regarding how the child is affected during daily activities (Child Impact Section, CIS), and four questions on how the family is affected by the child’s oral health (Family Impact Section, FIS) [5]. CIS encompasses four domains: Child Function, Child Psychology, Child Self-image, and Social Interaction, i.e. sleeping patterns, avoidance of certain foods, and social behaviour. The family impact section involves two domains: Parental Distress and Family Function, including aspects like loss of working hours due to dental concerns of the child. In summary, the parental answered ECOHIS examines how caries in preschool-aged children affect both the child’s and parental aspects of their lives.
In 2019, 23% of six-year-old children in Sweden were diagnosed with caries [8]. Understanding the impact of caries on society, especially when considering that nearly a quarter of preschool-aged children are affected, is still to be investigated. The ECOHIS instrument can serve as one piece of the puzzle to emphasize that caries is a more significant issue than just a dental concern.
The validation of both the original ECOHIS and its various versions has shown to be a strong and stable instrument [5,9–13]. The aim of this study was to develop a Swedish version of ECOHIS (S-ECOHIS), and to evaluate the instrument’s reliability, validity, and internal consistency. Additionally, the study aimed to analyze the OHRQoL of preschool children with experience of caries.
The study was designed as a cross-sectional study over a 12-month period spanning from August 2021 to August 2022. Children between the ages of 2 and 5 years visiting for re-calls, along with their caregivers, were recruited for the study from three dental clinics in the Public Dental Service of Region Västra Götaland and Region Halland. The sample was to include children diagnosed with caries, as well as children not diagnosed with caries.
The sample size calculations were based on Guedes et al. 2014, which provided the mean ± standard deviation (SD) of ECOHIS for both the caries and non-caries groups, by using https://clincalc.com/stats/samplesize.aspx [14]. According to the sample size calculations, 96 individuals were estimated to be needed in each group. Moreover, an additional 7% was included in the calculation for each group to account for any ‘don’t know’ responses and drop-outs (Ridell et al. 2015). From this, it was estimated that each group should consist of at least 102 individuals.
The ECOHIS instrument was originally developed in the United States [5]. This instrument comprises 13 items divided into two sections. Each item has six different response options; and each option generates a score ranging from 0–4. The response options include Never, Hardly ever, Occasionally, Often, Very often and Don’t know. The options Never and Don’t know generate a score of 0 in the original version. The score for CIS (questions 1–9) and FIS (questions 10–13) ranges from 0–36 and 0–16, respectively.
The methodology for this article comprises three stages.
The original ECOHIS version was translated into Swedish by using a double-blinded technique [5]. Firstly, the questionnaire was translated from English to Swedish by a native Swedish speaker.
Secondly, the initial Swedish version was translated back into English by an independent individual who is fluent in English and Swedish, and unfamiliar with the original ECOHIS version.
The English version derived from the Swedish translation was then compared with the original ECOHIS questionnaire, and necessary adjustments were made to the final Swedish version. This final version, S-ECOHIS, was subsequently tested on the study sample to assess the clarity of the item wordings, response options, and comprehensibility of the scale, see Appendix.
Prior to completing the S- ECOHIS questionnaire, caregivers were provided information regarding the aim of the study, and written consent was obtained. The caregivers answered the S-ECOHIS at a Public Dental Service visit for their child. They were instructed to consider their child’s life from birth until now, when responding to the questions.
During the dental visit, trained dentists conducted a standardized and routine clinical examination. To assess caries status, the Index of dmft (decayed, missed/extracted, filled teeth) was used and registered in the dental records [15]. Dental caries was assessed clinically. Teeth were reported as extracted if they were extracted due to caries. The Public Dental Service follows Swedish national guidelines and regularly conducts calibration for caries registration. The dmft data, registered in the dental records, was utilized for this study. Additionally, background information such as the patient’s age and gender were retrieved from the dental records.
The internal consistency and reliability of the Swedish version were assessed for all sections and questions using Cronbach’s Alpha coefficient. The maximum expected value for Cronbach’s Alpha was 0.90; any value above this would indicate redundancy in the test [16]. To measure the consistency of the study, the questionnaire was re-administered to 10 caregivers two weeks later, and the intra-class correlation coefficients (ICCs) were used for assessment. The coefficient score of ICC (0) – (1), with a score minimum of 0.7, is interpreted and considered to be acceptable [16]; 1 indicates a strong relationship between the test and re-test.
Each question in ECOHIS has four options of responses, which are rated on a 4-point Likert scale (Never = 0, Hardly ever = 1, Occasionally = 2, Often = 3, Very often = 4). The answer Don’t know in this study is calculated as the mean from the other responses in the same domain.
The dichotomized item responses Occasionally, Often and Very often were considered indicative of having had the experience, while the responses Never and Hardly ever were considered indicative of not being acquainted with the item. The results from the ECOHIS questionnaire were analyzed using independent t-test to compare the mean total scores between the caries and non-caries groups. Additionally, independent t-tests were conducted for the domains within the Children Impact Section (CIS) and the Family Impact Section (FIS). Comparisons between the groups concerning proportions were conducted by using Chi-2. A p-value of <0.05 was statistically significant.
All data were calculated using SPSS (25.0) (Statistical Package for the Social Sciences).
Ethical approval was obtained from the Swedish Ethical Review Authority (Dnr 2021-04880, September 2021).
Out of the initially selected children, all 274 caregivers chose to participate in the study. Among them, there were 145 (53%) boys and 129 (47%) girls. The mean age was 4.0 years for all children, with boys having an average age of 4.0 years and girls having an average age of 3.9 years. The age of the children ranged between 2 and 5 years old. The mean dmft score was 2.0 (std 3.235) ranging between 0–16.
Among the children, 117 (43%) had experienced caries (dmft > 0) and are referred to as the caries group. This group comprised of 64 boys and 53 girls, with a mean age of 4.2 years. The mean dmft score was 4.7 (std 3.477) ranging from 1–16.
Furthermore, two subgroups in the caries group were established: Children treated for caries (dmft > 0 where d = 0) and children who had not yet undergone treatment (d > 0). Analyses with independent t-test were conducted comparing the differences between these subgroups.
The non-caries group consisted of 157 (57%) children and had a score of dmft = 0, including 81 boys and 76 girls, with a mean age of 3.8 years.
All items were translated from English to Swedish, resulting in the S-ECOHIS (Appendix 1)
The S-ECOHIS item statistics and distribution of responses are presented in Tables 1 and 2. No missing responses were found. Caregivers reported that How often has your child pain from mouth, jaws or teeth because of dental problems or treatments was the most commonly experienced item in the CIS section of the S-ECOHIS (11%).
The response rate for Don’t know varied from 0 to 7% across the 13 items, with How often has your child difficulties pronouncing any words because of dental problems or treatments being the most frequently reported item with Don’t know.
The internal consistency reliability was assessed using Cronbach’s alpha resulting in 0.83 and 0.66, respectively for the child and family sections. For the total S-ECOHIS, including all items, the Cronbach’s alpha internal consistency reliability was 0.84.
The test-retest showed no difference in mean score of total S-ECOHIS, CIS, FIS, or any domain, when analyzed with independent t-test. The test-retest reliability was calculated via ICC (intraclass correlation coefficient), showing to be 0.95 of the total score of S-ECOHIS. The ICC for CIS was calculated to be 0.99, and for FIS, it was calculated to be 0.96.
For all participants the scores of CIS ranged from 0-33, with a mean of 1.77 (SD = 3.42). The highest domain within CIS was Child function, with a mean of 0.82 (SD = 1.82). In FIS, the scores ranged from 0-10, with a mean of 1.22 (SD = 2.17), see Table 1. The highest domain within FIS was Parental distress, with a mean of 0.86 (SD = 1.68). The distribution of responses to the items are listed in Table 2.
All item responses of Occasionally, Often and Very often were reported to a larger extent in the caries group, compared to the non-caries group (Chi-2, p < 0.05). In CIS, the item How often has your child pain from mouth, jaws or teeth was reported in 11% of all respondents, with a larger proportion (23%) in the caries group, compared to the non-caries group (Chi-2, p < 0.001). In FIS, the item How often have you or another family member felt guilty because of your child’s dental problems or treatment was reported in 18% of all caregivers, with a higher proportion in the caries group (40%), compared to 2% in the non-caries group (Chi-2, p < 0.001).
Furthermore, the mean scores of all items were higher in the caries group, compared to the non-caries group (independent t-test p < 0.05), see Figure 1.
Figure 1. Radar Plot of the mean responses to items in S-ECOHIS.
The analysis of the mean scores of S-ECOHIS between the caries group and the non-caries group is presented in Table 3(a). All domains showed significant differences between the groups, with caregivers in the caries group scoring higher, compared to the non-caries group (p < 0.005).
Furthermore, the two subgroups in the caries group i.e. children being treated for caries and children with untreated caries, were further analysed. Among children in the caries group, 15% (n = 18) had undergone dental treatment (dmft > 0 where d = 0), while 85% (n = 99) had untreated teeth (d > 0).
Independent t-test was performed to compare the mean of the score of the responses. Caregivers of children who had received dental treatment reported lower total scores in S-ECOHIS, compared caregivers of untreated children, see Table 3(b). Similar patterns were observed for the scores of the child and family sections.
Section | Domain | TREATED (N: 18) | UNTREATED (N: 99) | p | ||
Mean | SD | Mean | SD | |||
S-CIS | Child Symptoms | 0.33 | 0.59 | 0.88 | 1.06 | <0.005 |
Child Function | 0.72 | 1.23 | 1.82 | 2.60 | <0.05a | |
Child Psychology | 0.17 | 0.38 | 0.76 | 1.44 | <0.001 | |
Child Social | 0.17 | 0.51 | 0.28 | 0.88 | nsa | |
Total | 1.34 | 1.97 | 3.75 | 4.89 | <0.001 | |
S-FIS | Parental Distress | 0.78 | 1.35 | 2.00 | 2.11 | <0.005 |
Family Function | 0.33 | 0.60 | 0.85 | 1.21 | <0.005 | |
Total | 1.11 | 1.52 | 2.85 | 2.71 | <0.001 | |
S-ECOHIS | Total | 2.50 | 3.02 | 6.60 | 6.39 | <0.001 |
The p is the p-value calculated using independent samples t-test of equality of means of the groups, equal variances not assumed (Levene’s test for equality of variances). | ||||||
aindicating equal variances assumed (Levene’s test for equality of variances). Child Social: Child self-image and social interaction, SD: Standard deviation, ns: non-significant. |
Caries is a continuous global problem and should not be overlooked. Having an instrument capturing children’s point of view of their dental experience is crucial. Therefore, there is a clear need for a Swedish version of the ECOHIS questionnaire, to assess the impact of dental care and oral health in preschool children in Sweden. In conformity with articles in different languages of the instrument, the Swedish translation of ECOHIS was based on the English version [9–13,17,18]. There were no difficulties concerning the translation process to Swedish, considering the highly comprehensive results showing few responses of Don’t know in the S-ECOHIS version. The response option Don’t know is of significance as a confirmation that the caregiver considered and understood the questions in the questionnaire. In the S-ECOHIS, a Don’t know response for a single item is recalculated as the mean of the items in the domain. In contrast, the French, German, and original version discriminate, as Don’t know is given a score of zero [5,11,13]. Consequently, a Don’t know response that influences the score of ECOHIS will give rise to a negative impact of the caries experience, rather than a positive impact or non-impact.
A score of Cronbach’s Alpha >0.7 is considered acceptable for measuring internal consistency [16]. The result for the S-ECOHIS (α = 0.84) is satisfactory and indicates good reliability. The Cronbach’s Alpha of S-ECOHIS is congruent with the Lithuanian version (α = 0.87) and French version (α = 0.82) [13,17]. The test-retest reliability of S-ECOHIS was calculated via ICC for the total score and its two sections, CIS and FIS, which indicates excellent agreement between the test and retest groups. The total ICC score of S-ECOHIS aligns with the findings of the French version (0.95) [13]. In comparison, the German version and the Chinese version yielded total scores of 0.81 and 0.61, respectively [10,11]. The original ECOHIS version by Pahel et al. showed a ICC score of 0.84 [5].
The results highlight the impact of caries on the oral health-related quality of life (OHRQoL) of both children and their families, as observed in previous studies conducted in other countries [5,11]. Families are affected with parents often reporting feelings of guilt when their child is diagnosed with and affected by caries, a finding consistent with prior research [8]. These findings should be taken into consideration when meeting children and parents in clinical settings. Studying OHRQoL with input from children and analysing those with or without the experience of caries, provides valuable insight regarding the child’s situation, underscoring the importance of planning and organizing dental care for preschoolers. Children are profoundly affected by caries, particularly when it remains untreated. The substantial results obtained from S-ECOHIS can inform and shape attitudes toward future dental care. Previous studies have demonstrated that treating caries in preschool children can improve their OHRQoL [19,20]. Furthermore, research suggests that ECOHIS can assist in prioritizing dental care for preschoolers with caries, including treatment under general sedation [21]. The results of S-ECOHIS show that multi-focused dental care for children, including prevention as well as treating caries in the deciduous dentition, is of importance when considering the quality of life of young children.
The sample size could be considered a limitation. However, this study was performed at three clinics with children from families with varying socio-economic backgrounds and cultures, which should be viewed as a positive aspect. Children in socio-economic disadvantaged areas tend to have a higher rate of caries, compared to the general population [22,23]. Children living in socio-economically deprived areas are not only vulnerable to life’s challenges, but also face the additional risk of experiencing a lower quality of life due to the impact of caries. Additionally, children diagnosed with caries are at an increased risk of developing caries during their adolescence [24]. Prevention in dental care is essential for all children, not just for developing caries but for health-promoting reasons in general. Moreover, the significance of a Swedish version of ECOHIS is relevant in a country where dental care is free of charge for individuals up to the age of 19.
In summary, the findings of this study confirm that care-givers of children with caries report a higher S-ECOHIS score, indicating a negative impact of caries on oral health-related quality of life in preschool children. Studying how caries in preschool children affects the quality of life, both for children and their families, is crucial for current and future dental care. The results from the S- ECOHIS demonstrate good validity, test re-test reliability and internal consistency, similar to other available translations [9–13,17,18]. These results affirm the suitability of S-ECOHIS for use in both clinical and research works.
The Swedish version of ECOHIS that was developed demonstrates good validity, test-retest reliability, and internal consistency. The findings show that the oral health-related quality of life is adversely affected in preschool children with caries, with particular vulnerability observed among children with untreated caries. These results indicate that S-ECOHIS is suitable for use in future clinical and research endeavors.
Nina Sabel http://orcid.org/0000-0001-6707-4811
[1] Wu LL, Cheung KY, Lam PYP, et al. Oral health indicators for risk of malnutrition in elders. J Nutr Health Aging. 2018;22(2):254–261. doi: 10.1007/s12603-017-0887-2.
[2] Kimmie-Dhansay F, Pontes CC, Chikte UME, et al. Impacts of tooth loss on OHRQoL in an adult population in cape town, South Africa. Int J Environ Res Public Health. 2021;18:4989–4957.
[3] Jokovic A, Locker D, Guyatt G. Short forms of the child perceptions questionnaire for 11-14-year-old children (CPQ11-14): development and initial evaluation. Health Qual Life Outcomes. 2006;4(1):4–4. doi: 10.1186/1477-7525-4-4.
[4] Sinha N, Shankar D, Vaibhav V, et al. Oral health-related quality of life in children and adolescents of indian population. J Pharm Bioall Sci. 2020;12(5):619–622. doi: 10.4103/jpbs.JPBS_113_20.
[5] Pahel BT, Rozier RG, Slade GD. Parental perceptions of children’s oral health: the early childhood oral health impact scale (ECOHIS). Health Qual Life Outcomes. 2007;5(1):6–6. doi: 10.1186/1477-7525-5-6.
[6] Mota-Veloso I, Soares ME, Alencar BM, et al. Impact of untreated dental caries and its clinical consequences on the oral health-related quality of life of schoolchildren aged 8-10 years. Qual Life Res. 2016 Jan;25(1):193–199. doi: 10.1007/s11136-015-1059-7.
[7] Corrêa-Faria P, Daher A, Freire M, et al. Impact of untreated dental caries severity on the quality of life of preschool children and their families: a cross-sectional study. Qual Life Res. 2018;27(12):3191–3198. doi: 10.1007/s11136-018-1966-5.
[8] Munhälsoutveckling bland barn i förskoleålder. Samspelet mellan barns munhälsa och deras sociala och demografiska bakgrund https://www.socialstyrelsen.se/globalassets/sharepoint-dokument/artikelkatalog/ovrigt/2022-6-7991.pdf:12-15. Socialstyrelsen; 2022 [cited 2023 2023-06-25].
[9] Farsi NJ, El-Housseiny AA, Farsi DJ, et al. Validation of the arabic version of the early childhood oral health impact scale (ECOHIS). BMC Oral Health. 2017;17(1):60. doi: 10.1186/s12903-017-0353-x.
[10] Lee GH, McGrath C, Yiu CK, et al. Translation and validation of a Chinese language version of the early childhood oral health impact scale (ECOHIS). Int J Paediatr Dent. 2009;19(6):399–405. doi: 10.1111/j.1365-263X.2009.01000.x.
[11] Bekes K, Omara M, Safar S, et al. The german version of early childhood oral health impact scale (ECOHIS-G): translation, reliability, and validity. Clin Oral Investig. 2019;23(12):4449–4454. doi: 10.1007/s00784-019-02893-1.
[12] Bordoni N, Ciaravino O, Zambrano O, et al. Early childhood oral health impact scale (ECOHIS). translation and validation in Spanish language. Acta Odontol Latinoam. 2012;25(3):270–278.
[13] Li S, Veronneau J, Allison PJ. Validation of a French language version of the early childhood oral health impact scale (ECOHIS). Health Qual Life Outcomes. 2008 Jan 22;6(1):9. doi: 10.1186/1477-7525-6-9.
[14] Guedes RS, Piovesan C, Antunes JL, et al. Assessing individual and neighborhood social factors in child oral health-related quality of life: a multilevel analysis. Qual Life Res. 2014;23(9):2521–2530. doi: 10.1007/s11136-014-0690-z.
[15] WHO. Oral health surveys: basic methods. 5th edition ed. https://www.who.int/. France: World Health Organization; 2013.
[16] Bland JM, Altman DG. Cronbach’s alpha. BMJ. 1997;314(7080):572–572. doi: 10.1136/bmj.314.7080.572.
[17] Jankauskiene B, Narbutaite J, Kubilius R, et al. Adaptation and validation of the early childhood oral health impact scale in Lithuania. Stomatologija. 2012;14(4):108–113.
[18] Jabarifar SE, Golkari A, Ijadi MH, et al. Validation of a farsi version of the early childhood oral health impact scale (F-ECOHIS). BMC Oral Health. 2010;10(1):4. doi: 10.1186/1472-6831-10-4.
[19] Anderson HK, Drummond BK, Thomson WM. Changes in aspects of children’s oral-health-related quality of life following dental treatment under general anaesthesia. Int J Paediatr Dent. 2004;14(5):317–325. doi: 10.1111/j.1365-263X.2004.00572.x.
[20] Ridell K, Borgstrom M, Lager E, et al. Oral health-related quality-of-life in swedish children before and after dental treatment under general anesthesia. Acta Odontol Scand. 2015;73(1):1–7. doi: 10.3109/00016357.2014.919661.
[21] Grant CG, Daymont C, Rodd C, et al. Oral health-related quality of life of Canadian preschoolers with severe caries after dental rehabilitation under general anesthesia. Pediatr Dent. 2019;41(3):221–228.
[22] André Kramer A-C, Petzold M, Hakeberg M, et al. Multiple socioeconomic factors and dental caries in swedish children and adolescents. Caries Res. 2018;52(1-2):42–50. doi: 10.1159/000481411.
[23] André Kramer A-C, Pivodic A, Hakeberg M, et al. Multilevel analysis of dental caries in swedish children and adolescents in relation to socioeconomic status. Caries Res. 2019;53(1):96–106. doi: 10.1159/000489570.
[24] Isaksson H, Koch G, Alm A, et al. Parental factors in early childhood are associated with approximal caries experience in young adults-A longitudinal study. Community Dent Oral Epidemiol. 2019;47(1):49–57. doi: 10.1111/cdoe.12421.