Effects of physical exercise interventions on balance, postural stability and general mobility in Parkinson’s disease: a network meta-analysis
DOI:
https://doi.org/10.2340/jrm.v56.10329Keywords:
Parkinson disease, exercise, physical activity modalities, postural balance, mobility limitationAbstract
Objective: To assess which type of physical exercise intervention has the most beneficial effects on balance, postural stability and general mobility in patients with Parkinson’s disease. These parameters were assessed using the Activities-specific Balance Confidence (ABC) scale, Berg Balance Scale (BBS), Mini-Balance Evaluation Systems Test (MiniBESTest) and Timed Up and Go Test (TUG).
Design: Network meta-analysis.
Methods: The PubMed, Cochrane Central Register of Controlled Trials, and Web of Science databases were searched up to August 2022 to identify randomized controlled trials on the effects of physical exercise interventions on balance, postural stability, and general mobility. The network meta-analysis included pairwise and indirect comparisons of results on the ABC scale, BBS, MiniBESTest, and TUG across 8 categories of physical exercise.
Results: Eighty-six studies with a total of 4,693 patients were included. For the ABC scale, the indirect comparison showed that the highest effect size was observed for balance vs sensorimotor training without including endurance interventions (0.62; 95% confidence interval (95% CI) 0.06, 1.17). The highest effect sizes for BBS were observed for alternative exercises (1.21; 95% CI 0.62, 1.81), body-weight supported (BWS) interventions (1.31; 95% CI 0.57, 2.05), dance (1.18; 95% CI 0.33, 2.03) and sensorimotor training, including endurance interventions (1.10; 95% CI 0.46, 1.75) vs control groups. Indirect comparisons showed that the highest effect size for the MiniBESTest were observed for balance (0.75; 95% CI 0.46, 1.04) and resistance (0.58; 95% CI 0.10, 1.07) vs control groups. For the TUG, comparisons showed a significant effect size for alternative exercises (–0.54; 95% CI –0.82, –0.26), balance (–0.42; 95% CI –0.75, –0.08), resistance (–0.60; 95% CI –0.89, –0.31), and sensorimotor training including endurance interventions (–0.61; 95% CI –0.95, –0.27) vs control comparisons.
Conclusion: Balance interventions improve balance, postural stability, and general mobility in people with Parkinson’s disease. Moreover, alternative exercises, dance, BWS interventions, resistance, and sensorimotor training, including and not including endurance interventions, are also effective.
Downloads
References
Jankovic J. Parkinson’s disease: clinical features and diagnosis. J Neurol Neurosurg Psychiatry 2008; 79: 368–376.
https://doi.org/10.1136/JNNP.2007.131045 DOI: https://doi.org/10.1136/jnnp.2007.131045
Park J-H, Kang Y-J, Horak FB. What is wrong with balance in Parkinson’s disease? J Mov Disord 2015]; 8: 109–114.
https://doi.org/10.14802/JMD.15018 DOI: https://doi.org/10.14802/jmd.15018
Kim SD, Allen NE, Canning CG, Fung VSC. Postural instability in patients with Parkinson’s disease. CNS Drugs 2013; 27: 97–112.
https://doi.org/10.1007/s40263-012-0012-3 DOI: https://doi.org/10.1007/s40263-012-0012-3
Horak FB. Postural orientation and equilibrium: what do we need to know about neural control of balance to prevent falls? Age Ageing 2006; 35: ii7–ii11.
https://doi.org/10.1093/AGEING/AFL077 DOI: https://doi.org/10.1093/ageing/afl077
Dibble LE, Addison O, Papa E. The effects of exercise on balance in persons with Parkinson’s disease: a systematic review across the disability spectrum. J Neurol Phys Ther 2009; 33: 14–26.
https://doi.org/10.1097/NPT.0b013e3181990fcc DOI: https://doi.org/10.1097/NPT.0b013e3181990fcc
Sarter M, Albin RL, Kucinski A, Lustig C. Where attention falls: Increased risk of falls from the converging impact of cortical cholinergic and midbrain dopamine loss on striatal function. Exp Neurol 2014; 257: 120–129.
https://doi.org/10.1016/J.EXPNEUROL.2014.04.032 DOI: https://doi.org/10.1016/j.expneurol.2014.04.032
Bloem BR, Beckley DJ, van Dijk JG, Zwinderman AH, Remler MP, Roos RAC. Influence of dopaminergic medication on automatic postural responses and balance impairment in Parkinson’s disease. Mov Disord 1996; 11: 509–521.
https://doi.org/10.1002/mds.870110506 DOI: https://doi.org/10.1002/mds.870110506
McNeely ME, Duncan RP, Earhart GM. Medication improves balance and complex gait performance in Parkinson disease. Gait Posture 2012; 36: 144–148.
https://doi.org/10.1016/J.GAITPOST.2012.02.009 DOI: https://doi.org/10.1016/j.gaitpost.2012.02.009
St. George RJ, Nutt JG, Burchiel KJ, Horak FB. A meta-regression of the long-term effects of deep brain stimulation on balance and gait in PD. Neurology 201; 75: 1292–1299.
https://doi.org/10.1212/WNL.0B013E3181F61329 DOI: https://doi.org/10.1212/WNL.0b013e3181f61329
Radder DLM, Lígia Silva de Lima A, Domingos J, Keus SHJ, van Nimwegen M, Bloem BR, et al. Physiotherapy in Parkinson’s disease: a meta-analysis of present treatment modalities. Neurorehabil Neural Repair 2020; 34: 871–880.
https://doi.org/10.1177/1545968320952799 DOI: https://doi.org/10.1177/1545968320952799
Goodwin VA, Richards SH, Taylor RS, Taylor AH, Campbell JL. The effectiveness of exercise interventions for people with Parkinson’s disease: a systematic review and meta-analysis. Mov Disord 2008 [cited 2022 Mar 15]; 23(5): 631–640.
https://doi.org/10.1002/MDS.21922 DOI: https://doi.org/10.1002/mds.21922
Tomlinson CL, Patel S, Meek C, Clarke CE, Stowe R, Shah L, et al. Physiotherapy versus placebo or no intervention in Parkinson’s disease. Cochrane Database Syst Rev 2013;: CD002817. DOI: https://doi.org/10.1002/14651858.CD002817.pub4
https://doi.org/10.1002/14651858.CD002817.pub2 DOI: https://doi.org/10.1002/14651858.CD002817.pub2
Lorenzo-García P, Cavero-Redondo II, Torres-Costoso AI, Guzmán-Pavón MJ, Nuñez de Arenas-Arroyo S, Álvarez-Bueno C, et al. Body weight support gait training for patients with Parkinson disease: a systematic review and meta-analyses. Arch Phys Med Rehabil 2021; 102: 2012–2021.
https://doi.org/10.1016/j.apmr.2021.02.016 DOI: https://doi.org/10.1016/j.apmr.2021.02.016
Aras B, Seyyar GK, Fidan O, Colak E. The effect of tai chi on functional mobility, balance and falls in Parkinson’s disease: a systematic review and meta-analysis of systematic reviews. Explore (NY). 2022; 18: 402–410.
https://doi.org/10.1016/J.EXPLORE.2021.12.002 DOI: https://doi.org/10.1016/j.explore.2021.12.002
Braz de Oliveira MP, Maria Dos Reis L, Pereira ND. Effect of resistance exercise on body structure and function, activity, and participation in individuals with Parkinson disease: a systematic review. Arch Phys Med Rehabil 2021; 102: 1998–2011.
https://doi.org/10.1016/j.apmr.2021.01.081 DOI: https://doi.org/10.1016/j.apmr.2021.01.081
Li Y, Song H, Shen L, Wang Y. The efficacy and safety of moderate aerobic exercise for patients with Parkinson’s disease: a systematic review and meta-analysis of randomized controlled trials. Ann Palliat Med 2021; 10: 2638649–2632649.
https://doi.org/10.21037/APM-20-1661 DOI: https://doi.org/10.21037/apm-20-1661
Salari N, Hayati A, Kazeminia M, Rahmani A, Mohammadi M, Fatahian R, et al. The effect of exercise on balance in patients with stroke, Parkinson, and multiple sclerosis: a systematic review and meta-analysis of clinical trials. Neurol Sci Off J Ital Neurol Soc Ital Soc Clin Neurophysiol 2022; 43: 167–185.
https://doi.org/10.1007/s10072-021-05689-y DOI: https://doi.org/10.1007/s10072-021-05689-y
Gamborg M, Hvid LG, Dalgas U, Langeskov-Christensen M. Parkinson’s disease and intensive exercise therapy – an updated systematic review and meta-analysis. Acta Neurol Scand 2022; 145: 504–528.
https://doi.org/10.1111/ane.13579 DOI: https://doi.org/10.1111/ane.13579
Ernst M, Folkerts AK, Gollan R, Lieker E, Caro-Valenzuela J, Adams A, et al. Physical exercise for people with Parkinson’s disease: a systematic review and network meta-analysis. Cochrane Database Syst Rev 2023; 1: CD013856.
https://doi.org/10.1002/14651858.CD013856.PUB2 DOI: https://doi.org/10.1002/14651858.CD013856.pub2
Lorenzo-García P, Núñez de Arenas-Arroyo S, Cavero-Redondo I, Guzmán-Pavón MJ, Priego-Jiménez S, Álvarez-Bueno C. Physical exercise interventions on quality of life in Parkinson disease: a network meta-analysis. J Neurol Phys Ther 2023; 47: 64–74.
https://doi.org/10.1097/NPT.0000000000000414 DOI: https://doi.org/10.1097/NPT.0000000000000414
Higgins J, Thomas J, Chandler J, Cumpston M, Li T. Cochrane Handbook for Systematic Reviews of Interventions Version 6.2 (2021) [Serial on the Internet]. [cited 2022 Sep 8]. Available from: https://training.cochrane.org/handbook.
Hutton B, Catalá-López F, Moher D. The PRISMA statement extension for systematic reviews incorporating network meta-analysis: PRISMA-NMA. Med Clin (Barc) 2016; 147: 262–266. DOI: https://doi.org/10.1016/j.medcle.2016.10.003
https://doi.org/10.1016/j.medcli.2016.02.025 DOI: https://doi.org/10.1016/j.medcli.2016.02.025
Bloem BR, Marinus J, Almeida Q, Dibble L, Nieuwboer A, Post B, et al. Measurement instruments to assess posture, gait, and balance in Parkinson’s disease: critique and recommendations. Mov Disord 2016; 31: 1342–1355.
https://doi.org/10.1002/MDS.26572 DOI: https://doi.org/10.1002/mds.26572
Godi M, Franchignoni F, Caligari M, Giordano A, Turcato AM, Nardone A. Comparison of reliability, validity, and responsiveness of the Mini-BESTest and Berg Balance Scale in patients with balance disorders. Phys Ther 2013; 93: 158–167.
https://doi.org/10.2522/PTJ.20120171 DOI: https://doi.org/10.2522/ptj.20120171
Mancini M, Horak FB. The relevance of clinical balance assessment tools to differentiate balance deficits. Eur J Phys Rehabil Med 2010; 46: 239–248.
Tyson SF, Connell LA. How to measure balance in clinical practice. A systematic review of the psychometrics and clinical utility of measures of balance activity for neurological conditions. Clin Rehabil 2009; 23: 824–840.
https://doi.org/10.1177/0269215509335018 DOI: https://doi.org/10.1177/0269215509335018
Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ 2019; 366: 4898.
https://doi.org/10.1136/bmj.l4898 DOI: https://doi.org/10.1136/bmj.l4898
Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol 2011; 64: 380–382.
https://doi.org/10.1016/j.jclinepi.2010.09.011 DOI: https://doi.org/10.1016/j.jclinepi.2010.09.011
Osborne JA, Botkin R, Colon-Semenza C, DeAngelis TR, Gallardo OG, Kosakowski H, et al. Physical therapist management of Parkinson disease: a clinical practice guideline from the American Physical Therapy Association. Phys Ther 2022; 102: pzab302.
https://doi.org/10.1093/ptj/pzab302 DOI: https://doi.org/10.1093/ptj/pzab302
Reina-Gutiérrez S, Cavero-Redondo I, Martínez-Vizcaíno V, Núñez de Arenas-Arroyo S, López-Muñoz P, Álvarez-Bueno C, et al. The type of exercise most beneficial for quality of life in people with multiple sclerosis: a network meta-analysis. Ann Phys Rehabil Med 2022; 65: 101578.
https://doi.org/10.1016/J.REHAB.2021.101578 DOI: https://doi.org/10.1016/j.rehab.2021.101578
Salanti G. Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool. Res Synth Methods 2012; 3: 80–97.
https://doi.org/10.1002/JRSM.1037 DOI: https://doi.org/10.1002/jrsm.1037
Shim S, Yoon BH, Shin IS, Bae JM. Network meta-analysis: application and practice using Stata. Epidemiol Health 2017; 39: e2017047.
https://doi.org/10.4178/EPIH.E2017047 DOI: https://doi.org/10.4178/epih.e2017047
Chaimani A, Higgins JPT, Mavridis D, Spyridonos P, Salanti G. Graphical Tools for Network Meta-Analysis in STATA. Haibe-Kains B, editor. PLoS One 2013; 8: e76654.
https://doi.org/10.1371/journal.pone.0076654 DOI: https://doi.org/10.1371/journal.pone.0076654
Salanti G, Ades AE, Ioannidis JPA. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol 2011; 64: 163–171.
https://doi.org/10.1016/j.jclinepi.2010.03.016 DOI: https://doi.org/10.1016/j.jclinepi.2010.03.016
DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986; 7: 177–188.
https://doi.org/10.1016/0197-2456(86)90046-2 DOI: https://doi.org/10.1016/0197-2456(86)90046-2
Raad J, Moore J, Hamby J, Rivadelo RL, Straube D. A brief review of the activities-specific balance confidence scale in older adults. Arch Phys Med Rehabil 2013; 94: 1426–1427.
https://doi.org/10.1016/J.APMR.2013.05.002 DOI: https://doi.org/10.1016/j.apmr.2013.05.002
Qutubuddin AA, Pegg PO, Cifu DX, Brown R, McNamee S, Carne W. Validating the Berg Balance Scale for patients with Parkinson’s disease: a key to rehabilitation evaluation. Arch Phys Med Rehabil 2005; 86: 789–792.
https://doi.org/10.1016/j.apmr.2004.11.005 DOI: https://doi.org/10.1016/j.apmr.2004.11.005
Åberg AC, Olsson F, Åhman HB, Tarassova O, Arndt A, Giedraitis V, et al. Extraction of gait parameters from marker-free video recordings of Timed Up-and-Go tests: validity, inter- and intra-rater reliability. Gait Posture 2021; 90: 489–495.
https://doi.org/10.1016/J.GAITPOST.2021.08.004 DOI: https://doi.org/10.1016/j.gaitpost.2021.08.004
Leddy AL, Crowner BE, Earhart GM. Utility of the Mini-BESTest, BESTest, and BESTest sections for balance assessments in individuals with Parkinson disease. J Neurol Phys Ther 2011; 35: 90–97.
https://doi.org/10.1097/NPT.0B013E31821A620C DOI: https://doi.org/10.1097/NPT.0b013e31821a620c
Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002; 21: 1539–1558.
https://doi.org/10.1002/sim.1186 DOI: https://doi.org/10.1002/sim.1186
Sterne JAC, Egger M, Smith GD. Systematic reviews in health care: investigating and dealing with publication and other biases in meta-analysis. Br Med J 2001; 323: 101–105.
https://doi.org/10.1136/bmj.323.7304.101 DOI: https://doi.org/10.1136/bmj.323.7304.101
Yitayeh A, Teshome A. The effectiveness of physiotherapy treatment on balance dysfunction and postural instability in persons with Parkinson’s disease: a systematic review and meta-analysis. BMC Sports Sci Med Rehabil 2016; 8: 1–10. DOI: https://doi.org/10.1186/s13102-016-0042-0
https://doi.org/10.1186/S13102-016-0042-0/FIGURES/3
Acarer A, Karapolat H, Celebisoy N, Ozgen G, Colakoglu Z. Is customized vestibular rehabilitation effective in patients with Parkinson’s? NeuroRehabilitation 2015; 37: 255–262.
https://doi.org/10.3233/NRE-151258 DOI: https://doi.org/10.3233/NRE-151258
De Freitas PT TBMS, Leite PHWBS, Doná PT FP, Pompeu PT JEP, Swarowsky PT AP, Torriani-Pasin PT CP, et al. The effects of dual task gait and balance training in Parkinson’s disease: a systematic review. Physiother Theory Pract 2020; 36: 1088–1096.
https://doi.org/10.1080/09593985.2018.1551455 DOI: https://doi.org/10.1080/09593985.2018.1551455
Allen NE, Sherrington C, Paul SS, Canning CG. Balance and falls in Parkinson’s disease: a meta-analysis of the effect of exercise and motor training. Mov Disord 2011; 26: 1605–1615.
https://doi.org/10.1002/mds.23790 DOI: https://doi.org/10.1002/mds.23790
Johansson H, Freidle M, Ekman U, Schalling E, Leavy B, Svenningsson P, et al. Feasibility aspects of exploring exercise-induced neuroplasticity in Parkinson’s disease: a pilot randomized controlled trial. Parkinsons Dis 2020; 2020: 2410863.
https://doi.org/10.1155/2020/2410863 DOI: https://doi.org/10.1155/2020/2410863
Ismail SR, Lee SWH, Merom D, Kamaruddin PSNM, San Chong M, Ong T, et al. Evidence of disease severity, cognitive and physical outcomes of dance interventions for persons with Parkinson’s disease: a systematic review and meta-analysis. BMC Geriatr 2021; 21: 503.
https://doi.org/10.1186/s12877-021-02446-w DOI: https://doi.org/10.1186/s12877-021-02446-w
Wang L li, Sun C jie, Wang Y, Zhan T ting, Yuan J, Niu CY, et al. Effects of dance therapy on non-motor symptoms in patients with Parkinson’s disease: a systematic review and meta-analysis. Aging Clin Exp Res 2022; 34: 1201–1208. DOI: https://doi.org/10.1007/s40520-021-02030-7
https://doi.org/10.1007/S40520-021-02030-7/FIGURES/2
Jin X, Wang L, Liu S, Zhu L, Loprinzi PD, Fan X. The impact of mind-body exercises on motor function, depressive symptoms, and quality of life in Parkinson’s disease: a systematic review and meta-analysis. Int J Environ Res Public Health 2019; 17: 31.
https://doi.org/10.3390/ijerph17010031 DOI: https://doi.org/10.3390/ijerph17010031
Ravenek MJ, Schneider MA. Social support for physical activity and perceptions of control in early Parkinson’s disease. Disabil Rehabil 2009; 31: 1925–1936.
https://doi.org/10.1080/09638280902850261 DOI: https://doi.org/10.1080/09638280902850261
Valverde Guijarro E, Flórez García MT. Efecto de la danza en los enfermos de Parkinson. Fisioterapia 2012; 34: 216–224.
https://doi.org/10.1016/J.FT.2012.03.006 DOI: https://doi.org/10.1016/j.ft.2012.03.006
Mustafaoglu R, Ahmed I, Pang MYC. Which type of mind–body exercise is most effective in improving functional performance and quality of life in patients with Parkinson’s disease? A systematic review with network meta-analysis. Acta Neurol Belg 2022; 122: 1433–1446. DOI: https://doi.org/10.1007/s13760-022-02070-4
https://doi.org/10.1007/S13760-022-02070-4/FIGURES/4
Mak MK, Wong-Yu IS, Shen X, Chung CL. Long-term effects of exercise and physical therapy in people with Parkinson disease. Nat Rev Neurol 2017; 13: 689–703.
https://doi.org/10.1038/nrneurol.2017.128 DOI: https://doi.org/10.1038/nrneurol.2017.128
Fisher BE, Wu AD, Salem GJ, Song J, Lin CH (Janice), Yip J, et al. The effect of exercise training in improving motor performance and corticomotor excitability in people with early Parkinson’s disease. Arch Phys Med Rehabil 2008; 89: 1221–1229.
https://doi.org/10.1016/j.apmr.2008.01.013 DOI: https://doi.org/10.1016/j.apmr.2008.01.013
Hesse S, Schmidt H, Werner C, Bardeleben A. Upper and lower extremity robotic devices for rehabilitation and for studying motor control. Curr Opin Neurol 2003; 16: 705–710.
https://doi.org/10.1097/00019052-200312000-00010 DOI: https://doi.org/10.1097/00019052-200312000-00010
Hass CJ, Buckley TA, Pitsikoulis C, Barthelemy EJ. Progressive resistance training improves gait initiation in individuals with Parkinson’s disease. Gait Posture 2012; 35: 669–673.
https://doi.org/10.1016/J.GAITPOST.2011.12.022 DOI: https://doi.org/10.1016/j.gaitpost.2011.12.022
Alvarez-Bueno C, Deeks JJ, Cavero-Redondo II, Jolly K, Torres-Costoso AI, Price M, et al. Effect of exercise on motor symptoms in patients with Parkinson’s disease: a network meta-analysis. J Geriatr Phys Ther 2023; 46: E87–E105.
https://doi.org/10.1519/JPT.0000000000000322 DOI: https://doi.org/10.1519/JPT.0000000000000322
de Almeida FO, Santana V, Corcos DM, Ugrinowitsch C, Silva-Batista C. Effects of endurance training on motor signs of Parkinson’s disease: a systematic review and meta-analysis. Sport Med 2022; 52: 1789–1815. DOI: https://doi.org/10.1007/s40279-022-01650-x
https://doi.org/10.1007/S40279-022-01650-X/TABLES/7
Mrowczynski W. Health benefits of endurance training: implications of the brain-derived neurotrophic factor-a systematic review. NEURAL Plast 2019; 2019: 5413067.
https://doi.org/10.1155/2019/5413067 DOI: https://doi.org/10.1155/2019/5413067
Klamroth S, Steib S, Devan S, Pfeifer K. Effects of exercise therapy on postural instability in Parkinson disease: a meta-analysis. J Neurol Phys Ther 2016; 40: 3–14.
https://doi.org/10.1097/NPT.0000000000000117 DOI: https://doi.org/10.1097/NPT.0000000000000117
Ellis T, Rochester L. Mobilizing Parkinson’s disease: the future of exercise. J Parkinsons Dis 2018; 8: S95–S100.
https://doi.org/10.3233/JPD-181489 DOI: https://doi.org/10.3233/JPD-181489
Ellis TD, Colón-Semenza C, DeAngelis TR, Thomas CA, Hilaire M-H Saint, Earhart GM, et al. Evidence for early and regular physical therapy and exercise in Parkinson’s disease. Semin Neurol 2021; 41: 189–205.
https://doi.org/10.1055/s-0041-1725133 DOI: https://doi.org/10.1055/s-0041-1725133
Martignon C, Pedrinolla A, Ruzzante F, Giuriato G, Laginestra FG, Bouça-Machado R, et al. Guidelines on exercise testing and prescription for patients at different stages of Parkinson’s disease. Aging Clin Exp Res 2021; 33: 221–246.
https://doi.org/10.1007/s40520-020-01612-1 DOI: https://doi.org/10.1007/s40520-020-01612-1
Additional Files
Published
How to Cite
License
Copyright (c) 2024 Patricia Lorenzo-García, Iván Cavero-Redondo, Sergio Núñez de Arenas-Arroyo, María José Guzmán-Pavón, Susana Priego-Jiménez, Celia Álvarez-Bueno
This work is licensed under a Creative Commons Attribution 4.0 International License.
All digitalized JRM contents is available freely online. The Foundation for Rehabilitation Medicine owns the copyright for all material published until volume 40 (2008), as from volume 41 (2009) authors retain copyright to their work and as from volume 49 (2017) the journal has been published Open Access, under CC-BY-NC licences (unless otherwise specified). The CC-BY-NC licenses allow third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for non-commercial purposes, provided proper attribution to the original work.
From 2024, articles are published under the CC-BY licence. This license permits sharing, adapting, and using the material for any purpose, including commercial use, with the condition of providing full attribution to the original publication.
