A reliable and valid assessment of upper limb movement quality after stroke: the observational Drinking Task Assessment
DOI:
https://doi.org/10.2340/jrm.v56.40362Keywords:
movement quality, kinematics, compensatory movement strategies, hemiparesis, reliability, validity, observational assessment, upper limbAbstract
Objective: To develop and evaluate the reliability and validity of a new observational Drinking Task Assessment (DTA) designed to assess quality of movement in task performance after stroke.
Design: Reliability and validity.
Methods: The DTA measures movement time and movement quality (smoothness, trunk, shoulder, elbow, and grasp movements) on a 4-level ordinal scale. Thirty participants with chronic stroke were assessed independently by 2 therapists. Intra-class correlation (ICC), standard error of measurement (SEM) and minimal real difference (MRD), weighted kappa, percentage of agreement, and Svensson method were used for reliability assessment. Motion capture-based kinematics and established clinical scales were used to evaluate validity.
Results: The absolute SEM and MRD for movement time were 0.4 and 1 s (11%), respectively. The ICC (≥ 0.93) and weighted kappa (0.71–1.0) showed good to excellent agreement for intra- and inter-rater reliability. DTA showed strong correlations with Fugl–Meyer Assessment (0.74), Action Research Arm Test (0.93), and kinematic measures of smoothness (0.93), trunk displacement (0.91), elbow extension (0.73), and shoulder movements (0.56), indicating good construct validity.
Conclusions: The new DTA proved to be a reliable and valid tool for assessment of movement quality during task performance after stroke.
Downloads
References
Global, regional, and national burden of stroke and its risk factors, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet Neurol 2021; 20: 795-820.
Persson HC, Parziali M, Danielsson A, Sunnerhagen KS. Outcome and upper extremity function within 72 hours after first occasion of stroke in an unselected population at a stroke unit: a part of the SALGOT study. BMC Neurol 2012; 12: 162.
https://doi.org/10.1186/1471-2377-12-162 DOI: https://doi.org/10.1186/1471-2377-12-162
Simpson LA, Hayward KS, McPeake M, Field TS, Eng JJ. Challenges of estimating accurate prevalence of arm weakness early after stroke. Neurorehabil Neural Repair 2021; 35: 871-879.
https://doi.org/10.1177/15459683211028240 DOI: https://doi.org/10.1177/15459683211028240
Hartman-Maeir A, Soroker N, Oman SD, Katz N. Awareness of disabilities in stroke rehabilitation: a clinical trial. Disabil Rehabil 2003; 25: 35-44. DOI: https://doi.org/10.1080/713813429
https://doi.org/10.1080/0963828021000007897 DOI: https://doi.org/10.1080/0963828021000007897
Riksstroke. The Swedish Stroke Register. Annual Report 2020. [cited 2021-06-29] Available from: http://www.riksstroke.org.
Nijland RH, van Wegen EE, Harmeling-van der Wel BC, Kwakkel G, Investigators E. Presence of finger extension and shoulder abduction within 72 hours after stroke predicts functional recovery: early prediction of functional outcome after stroke: the EPOS cohort study. Stroke 2010; 41: 745-750.
https://doi.org/10.1161/STROKEAHA.109.572065 DOI: https://doi.org/10.1161/STROKEAHA.109.572065
Alt Murphy M, Willen C, Sunnerhagen KS. Kinematic variables quantifying upper-extremity performance after stroke during reaching and drinking from a glass. Neurorehabil Neural Repair 2011; 25: 71-80.
https://doi.org/10.1177/1545968310370748 DOI: https://doi.org/10.1177/1545968310370748
Rohrer B, Fasoli S, Krebs HI, Hughes R, Volpe B, Frontera WR, et al. Movement smoothness changes during stroke recovery. J Neurosci 2002; 22: 8297-8304.
https://doi.org/10.1523/JNEUROSCI.22-18-08297.2002 DOI: https://doi.org/10.1523/JNEUROSCI.22-18-08297.2002
Alt Murphy M, Häger CK. Kinematic analysis of the upper extremity after stroke: how far have we reached and what have we grasped? Phys Ther Rev 2015; 20: 137-155.
https://doi.org/10.1179/1743288X15Y.0000000002 DOI: https://doi.org/10.1179/1743288X15Y.0000000002
Schwarz A, Kanzler CM, Lambercy O, Luft AR, Veerbeek JM. Systematic review on kinematic assessments of upper limb movements after stroke. Stroke 2019; 50: 718-727.
https://doi.org/10.1161/STROKEAHA.118.023531 DOI: https://doi.org/10.1161/STROKEAHA.118.023531
Roby-Brami A, Feydy A, Combeaud M, Biryukova EV, Bussel B, Levin MF. Motor compensation and recovery for reaching in stroke patients. Acta Neurol Scand 2003; 107: 369-381.
https://doi.org/10.1034/j.1600-0404.2003.00021.x DOI: https://doi.org/10.1034/j.1600-0404.2003.00021.x
Thielman G, Kaminski T, Gentile AM. Rehabilitation of reaching after stroke: comparing 2 training protocols utilizing trunk restraint. Neurorehabil Neural Repair 2008; 22: 697-705.
https://doi.org/10.1177/1545968308315998 DOI: https://doi.org/10.1177/1545968308315998
Cirstea MC, Levin MF. Compensatory strategies for reaching in stroke. Brain 2000; 123: 940-953.
https://doi.org/10.1093/brain/123.5.940 DOI: https://doi.org/10.1093/brain/123.5.940
van Kordelaar J, van Wegen EE, Kwakkel G. Unraveling the interaction between pathological upper limb synergies and compensatory trunk movements during reach-to-grasp after stroke: a cross-sectional study. Experimental brain research. Experimentelle Hirnforschung. Experimentation cérébrale 2012; 221: 251-262.
https://doi.org/10.1007/s00221-012-3169-6 DOI: https://doi.org/10.1007/s00221-012-3169-6
Cirstea MC, Levin MF. Improvement of arm movement patterns and endpoint control depends on type of feedback during practice in stroke survivors. Neurorehabil Neural Repair 2007; 21: 398-411.
https://doi.org/10.1177/1545968306298414 DOI: https://doi.org/10.1177/1545968306298414
Langhorne P, Coupar F, Pollock A. Motor recovery after stroke: a systematic review. Lancet Neurol 2009; 8: 741-754.
https://doi.org/10.1016/S1474-4422(09)70150-4 DOI: https://doi.org/10.1016/S1474-4422(09)70150-4
Kwakkel G, Stinear C, Essers B, Munoz-Novoa M, Branscheidt M, Cabanas-Valdes R, et al. Motor rehabilitation after stroke: European Stroke Organisation (ESO) consensus-based definition and guiding framework. Eur Stroke J 2023: 23969873231191304.
https://doi.org/10.1177/23969873231191304 DOI: https://doi.org/10.1177/23969873231191304
Kwakkel G, van Wegen EEH, Burridge JH, Winstein CJ, van Dokkum LEH, Alt Murphy M, et al. Standardized measurement of quality of upper limb movement after stroke: consensus-based core recommendations from the Second Stroke Recovery and Rehabilitation Roundtable. Neurorehabil Neural Repair 2019; 33: 951-958.
https://doi.org/10.1177/1545968319886477 DOI: https://doi.org/10.1177/1545968319886477
Bernhardt J, Hayward KS, Dancause N, Lannin NA, Ward NS, Nudo RJ, et al. A stroke recovery trial development framework: consensus-based core recommendations from the Second Stroke Recovery and Rehabilitation Roundtable. Neurorehabil Neural Repair 2019; 33: 959-969.
https://doi.org/10.1177/1545968319888642 DOI: https://doi.org/10.1177/1545968319888642
Pohl J, Held JPO, Verheyden G, Alt Murphy M, Engelter S, Floel A, et al. Consensus-based core set of outcome measures for clinical motor rehabilitation after stroke: a Delphi study. Front Neurol 2020; 11: 875.
https://doi.org/10.3389/fneur.2020.00875 DOI: https://doi.org/10.3389/fneur.2020.00875
Quinn L, Riley N, Tyrell CM, Judd DL, Gill-Body KM, Hedman LD, et al. A framework for movement analysis of tasks: recommendations from the Academy of Neurologic Physical Therapy's Movement System Task Force. Phys Ther 2021; 101: pzab154.
https://doi.org/10.1093/ptj/pzab154 DOI: https://doi.org/10.1093/ptj/pzab154
Bernhardt J, Bate PJ, Matyas TA. Accuracy of observational kinematic assessment of upper-limb movements. Phys Ther 1998; 78: 259-270.
https://doi.org/10.1093/ptj/78.3.259 DOI: https://doi.org/10.1093/ptj/78.3.259
Levin MF, Desrosiers J, Beauchemin D, Bergeron N, Rochette A. Development and validation of a scale for rating motor compensations used for reaching in patients with hemiparesis: the reaching performance scale. Phys Ther 2004; 84: 8-22.
https://doi.org/10.1093/ptj/84.1.8 DOI: https://doi.org/10.1093/ptj/84.1.8
Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol 2010; 10: 22.
https://doi.org/10.1186/1471-2288-10-22 DOI: https://doi.org/10.1186/1471-2288-10-22
Alt Murphy M, Murphy S, Persson HC, Bergstrom UB, Sunnerhagen KS. Kinematic analysis using 3D motion capture of drinking task in people with and without upper-extremity impairments. J Vis Exp 2018: 57228.
https://doi.org/10.3791/57228-v DOI: https://doi.org/10.3791/57228-v
Frykberg GE, Grip H, Alt Murphy M. How many trials are needed in kinematic analysis of reach-to-grasp? A study of the drinking task in persons with stroke and non-disabled controls. J Neuroeng Rehabil 2021; 18: 101.
https://doi.org/10.1186/s12984-021-00895-3 DOI: https://doi.org/10.1186/s12984-021-00895-3
Alt Murphy M, Willen C, Sunnerhagen KS. Movement kinematics during a drinking task are associated with the activity capacity level after stroke. Neurorehabil Neural Repair 2012; 26: 1106-1115.
https://doi.org/10.1177/1545968312448234 DOI: https://doi.org/10.1177/1545968312448234
Nordin A, Alt Murphy M, Danielsson A. Intra-rater and inter-rater reliability at the item level of the Action Research Arm Test for patients with stroke. J Rehabil Med 2014; 46: 738-745.
https://doi.org/10.2340/16501977-1831 DOI: https://doi.org/10.2340/16501977-1831
Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance. Scand J Rehabil Med 1975; 7: 13-31.
https://doi.org/10.2340/1650197771331 DOI: https://doi.org/10.2340/1650197771331
Yozbatiran N, Der-Yeghiaian L, Cramer SC. A standardized approach to performing the action research arm test. Neurorehabil Neural Repair 2008; 22: 78-90.
https://doi.org/10.1177/1545968307305353 DOI: https://doi.org/10.1177/1545968307305353
Hernandez ED, Galeano CP, Barbosa NE, Forero SM, Nordin A, Sunnerhagen KS, et al. Intra- and inter-rater reliability of Fugl-Meyer Assessment of Upper Extremity in stroke. J Rehabil Med 2019; 51: 652-659.
https://doi.org/10.2340/16501977-2590 DOI: https://doi.org/10.2340/16501977-2590
Alt Murphy M, Resteghini C, Feys P, Lamers I. An overview of systematic reviews on upper extremity outcome measures after stroke. BMC Neurol 2015; 15: 29.
https://doi.org/10.1186/s12883-015-0292-6 DOI: https://doi.org/10.1186/s12883-015-0292-6
Penta M, Tesio L, Arnould C, Zancan A, Thonnard JL. The ABILHAND questionnaire as a measure of manual ability in chronic stroke patients: Rasch-based validation and relationship to upper limb impairment. Stroke 2001; 32: 1627-1634.
https://doi.org/10.1161/01.STR.32.7.1627 DOI: https://doi.org/10.1161/01.STR.32.7.1627
Duncan PW, Bode RK, Min Lai S, Perera S. Rasch analysis of a new stroke-specific outcome scale: the Stroke Impact Scale. Arch Phys Med Rehabil 2003; 84: 950-963.
https://doi.org/10.1016/S0003-9993(03)00035-2 DOI: https://doi.org/10.1016/S0003-9993(03)00035-2
Fleiss JL, Levin BA, Paik MC. Statistical methods for rates and proportions. Hoboken, NJ: Wiley; 2003.
https://doi.org/10.1002/0471445428 DOI: https://doi.org/10.1002/0471445428
Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res 2005; 19: 231-240.
https://doi.org/10.1519/00124278-200502000-00038 DOI: https://doi.org/10.1519/00124278-200502000-00038
Ekstrand E, Lexell J, Brogardh C. Test-retest reliability and convergent validity of three manual dexterity measures in persons with chronic stroke. PM R 2016; 8: 935-943.
https://doi.org/10.1016/j.pmrj.2016.02.014 DOI: https://doi.org/10.1016/j.pmrj.2016.02.014
Svensson E. Different ranking approaches defining association and agreement measures of paired ordinal data. Stat Med 2012; 31: 3104-3117.
https://doi.org/10.1002/sim.5382 DOI: https://doi.org/10.1002/sim.5382
Schober P, Boer C, Schwarte LA. Correlation coefficients: appropriate use and interpretation. Anesth Analg 2018; 126: 1763-1768.
https://doi.org/10.1213/ANE.0000000000002864 DOI: https://doi.org/10.1213/ANE.0000000000002864
Ferrarello F, Bianchi VAM, Baccini M, Rubbieri G, Mossello E, Cavallini MC, et al. Tools for observational gait analysis in patients with stroke: a systematic review. Phys Ther 2013; 93: 1673-1685.
https://doi.org/10.2522/ptj.20120344 DOI: https://doi.org/10.2522/ptj.20120344
Subramanian SK, Banina MC, Turolla A, Levin MF. Reaching performance scale for stroke: test-retest reliability, measurement error, concurrent and discriminant validity. PM R 2022; 14: 337-347.
https://doi.org/10.1002/pmrj.12584 DOI: https://doi.org/10.1002/pmrj.12584
Chen H-M, Chen CC, Hsueh I-P, Huang S-L, Hsieh C-L. Test-retest reproducibility and smallest real difference of 5 hand function tests in patients with stroke. Neuroreha-bil Neural Repair 2009; 23: 435-440.
https://doi.org/10.1177/1545968308331146
Flansbjer U-B, Holmbäck AM, Downham D, Lexell J. What change in isokinetic knee muscle strength can be detected in men and women with hemiparesis after stroke? Clin Rehabil 2005; 19: 514-522.
https://doi.org/10.1191/0269215505cr854oa DOI: https://doi.org/10.1191/0269215505cr854oa
Chen HM, Chen CC, Hsueh IP, Huang SL, Hsieh CL. Test-retest reproducibility and smallest real difference of 5 hand function tests in patients with stroke. Neurorehabil Neural Repair 2009; 23: 435-440.
https://doi.org/10.1177/1545968308331146 DOI: https://doi.org/10.1177/1545968308331146
Alt Murphy M, Sunnerhagen KS, Johnels B, Willen C. Three-dimensional kinematic motion analysis of a daily activity drinking from a glass: a pilot study. J Neuroeng Rehabil 2006; 3: 18.
https://doi.org/10.1186/1743-0003-3-18 DOI: https://doi.org/10.1186/1743-0003-3-18
Patterson TS, Bishop MD, McGuirk TE, Sethi A, Richards LG. Reliability of upper extremity kinematics while performing different tasks in individuals with stroke. J Mot Behav 2011; 43: 121-130.
https://doi.org/10.1080/00222895.2010.548422 DOI: https://doi.org/10.1080/00222895.2010.548422
Sousa ASP, da Silva CIC, Mesquita IA, Silva A, Macedo R, Imatz-Ojanguren E, et al. Optimal multifield functional electrical stimulation parameters for the "drinking task - reaching phase" and related upper limb kinematics repeatability in post stroke subjects. J Hand Ther 2022; 35: 645-654.
https://doi.org/10.1016/j.jht.2021.05.002 DOI: https://doi.org/10.1016/j.jht.2021.05.002
Hussain N, Alt Murphy M, Lundgren-Nilsson A, Sunnerhagen KS. Relationship between self-reported and objectively measured manual ability varies during the first year post-stroke. Sci Rep 2020; 10: 5093.
https://doi.org/10.1038/s41598-020-61834-1 DOI: https://doi.org/10.1038/s41598-020-61834-1
Additional Files
Published
How to Cite
License
Copyright (c) 2024 Minnu Jose, Maria Munoz-Novoa, Margit Alt Murphy
This work is licensed under a Creative Commons Attribution 4.0 International License.
All digitalized JRM contents is available freely online. The Foundation for Rehabilitation Medicine owns the copyright for all material published until volume 40 (2008), as from volume 41 (2009) authors retain copyright to their work and as from volume 49 (2017) the journal has been published Open Access, under CC-BY-NC licences (unless otherwise specified). The CC-BY-NC licenses allow third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for non-commercial purposes, provided proper attribution to the original work.
From 2024, articles are published under the CC-BY licence. This license permits sharing, adapting, and using the material for any purpose, including commercial use, with the condition of providing full attribution to the original publication.
