Inter-rater reliability and construct validity of a cross-diagnostic movement quality score for rehabilitation assessment
DOI:
https://doi.org/10.2340/jrm.v58.45701Keywords:
Movement Quality, inter-rater reliability, Construct validity, Functional Independence Measure, rehabilitation, Physical therapy assessmentAbstract
Objective: To examine the inter-rater reliability and construct validity of a Movement Quality Score (MQS) within the Standard Physical Therapy Assessment (SPTA) across diagnostic groups.
Design: Cross-sectional study.
Subjects and Methods: Eighty-four hospitalized patients undergoing rehabilitation for neurological, musculoskeletal, or internal medical conditions were included. Inter-rater reliability was assessed in 68 participants independently evaluated by 2 physiotherapists. The MQS was scored using the SPTA component. Inter-rater reliability of the summed score was analysed using the intraclass correlation coefficient (ICC [2,1]). Construct validity was examined using Spearman’s rank correlations between the MQS and the Functional Independence Measure (FIM) motor total score and its subdomains (self-care, sphincter control, transfers, and locomotion), as well as other SPTA components.
Results: The MQS demonstrated excellent inter-rater reliability (ICC [2,1] = 0.93). It showed a very strong correlation with the FIM motor total score (ρ = 0.91, p < 0.001), with strong associations for transfers and locomotion (ρ = 0.92) and self-care (ρ = 0.86). The correlation with sphincter control was lower (ρ = 0.68).
Conclusion: The MQS demonstrates excellent reliability and strong construct validity, supporting its use as a movement-focused complement to activities of daily living-based assessments in heterogeneous rehabilitation populations.
Downloads
References
World Health Organization. Rehabilitation 2030: meeting report, Geneva, Switzerland, 10–11 July 2023. Geneva: World Health Organization; 2023.
World Health Organization. Package of interventions for rehabilitation: module 1: introduction. Geneva: World Health Organization; 2023.
Tsuji T. Rehabilitation for elderly patients with cancer: importance in functional recovery and maintenance of ADL. Jpn J Clin Oncol 2022; 52: 1097–1104. DOI: https://doi.org/10.1093/jjco/hyac139
Flint KM, Stevens-Lapsley J, Forman DE. Cardiac rehabilitation in frail older adults with cardiovascular disease: a new diagnostic and treatment paradigm. J Cardiopulm Rehabil Prev 2020; 40: 72–78. DOI: https://doi.org/10.1097/HCR.0000000000000492
World Health Organization. International Classification of Functioning, Disability and Health (ICF). Geneva: World Health Organization; 2001.
Pollard B, Johnston M, Dieppe P. What do osteoarthritis health outcome instruments measure? Impairment, activity limitation, or participation restriction? J Rheumatol 2006; 33: 757–763.
Tarvonen-Schröder S, Laimi K, Kauko T, Saltychev M. Concepts of capacity and performance in assessment of functioning amongst stroke survivors: a comparison of the Functional Independence Measure and the International Classification of Functioning, Disability and Health. J Rehabil Med 2015; 47: 662–664. DOI: https://doi.org/10.2340/16501977-1974
Holden MK, Gill KM, Magliozzi MR. Gait assessment for neurologically impaired patients: standards for outcome assessment. Phys Ther 1984; 64: 35–40. DOI: https://doi.org/10.1093/ptj/64.1.35
Perry J, Garrett M, Gronley JK, Mulroy SJ. Classification of walking handicap in the stroke population. Stroke 1995; 26: 982–989. DOI: https://doi.org/10.1161/01.STR.26.6.982
Medical Research Council. Aids to the examination of the peripheral nervous system. London: HMSO; 1976.
Taub E, Uswatte G, Morris DM. Improved motor activity after constraint-induced movement therapy in stroke patients. Stroke 2001; 32: 131–137.
Harada K, Shimada H, Sawyer P, Asakawa Y, Nihei K, Kaneya S, et al. Life-space of community-dwelling older adults using preventive health care services in Japan. Nihon Koshu Eisei Zasshi 2010; 57: 526–537.
Kidd D, Stewart G, Baldry J, Johnson J, Rossiter D, Petruckevitch A, et al. The Functional Independence Measure: a comparative validity and reliability study. Disabil Rehabil 1995; 17: 10–14. DOI: https://doi.org/10.3109/09638289509166622
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016; 15: 155–163. DOI: https://doi.org/10.1016/j.jcm.2016.02.012
Stratford PW, Goldsmith CH. Use of the standard error as a reliability index of interest: an applied example using elbow flexor strength data. Phys Ther 1997; 77: 745–750. DOI: https://doi.org/10.1093/ptj/77.7.745
Hamilton BB, Laughlin JA, Fiedler RC, Granger CV. Interrater reliability of the 7-level functional independence measure. J Rehabil Med 1994; 26: 115–119. DOI: https://doi.org/10.2340/1650197794115119
Berg KO, Wood-Dauphinee SL, Williams JI, Maki B. Measuring balance in the elderly: validation of an instrument. Can J Public Health 1992; 83: S7–S11.
Hermans G, Clerckx B, Vanhullebusch T, Segers J, Vanpee G, Robbeets C, et al. Interobserver agreement of Medical Research Council sum score and handgrip strength in the intensive care unit. Muscle Nerve 2012; 45: 18–25. DOI: https://doi.org/10.1002/mus.22219
Rider LG, Koziol D, Giannini EH, Jain MS, Smith MR, Whitney-Mahoney K, et al. Validation of manual muscle testing and a subset of eight muscles for adult and juvenile idiopathic inflammatory myopathies. Arthritis Care Res (Hoboken) 2010; 62: 465–472. DOI: https://doi.org/10.1002/acr.20035
Van der Lee JH, Beckerman H, Knol DL, de Vet HCW, Bouter LM. Clinimetric properties of the Motor Activity Log for the assessment of arm use in hemiparetic patients. Stroke 2004; 35: 1410–1414. DOI: https://doi.org/10.1161/01.STR.0000126900.24964.7e
Baker PS, Bodner EV, Allman RM. Measuring life-space mobility in community-dwelling older adults. J Am Geriatr Soc 2003; 51: 1610–1614. DOI: https://doi.org/10.1046/j.1532-5415.2003.51512.x
Harada K, Shimada H, Sawyer P, Hotta R, Hayashi T, Suzuki T, et al. Life-space mobility in older adults: a Japanese version of the Life-Space Assessment (LSA-J). BMC Geriatr 2010; 10: 1–8.
Additional Files
Published
How to Cite
License
Copyright (c) 2026 Koji Ohata, Takeshi Kozakai, Kazuhisa Someya, Takatomi Narita, Natsuki Watanabe, Yuko Mine, Shinichi Daikuya
This work is licensed under a Creative Commons Attribution 4.0 International License.
All digitalized JRM contents is available freely online. The Foundation for Rehabilitation Medicine owns the copyright for all material published until volume 40 (2008), as from volume 41 (2009) authors retain copyright to their work and as from volume 49 (2017) the journal has been published Open Access, under CC-BY-NC licences (unless otherwise specified). The CC-BY-NC licenses allow third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for non-commercial purposes, provided proper attribution to the original work.
From 2024, articles are published under the CC-BY licence. This license permits sharing, adapting, and using the material for any purpose, including commercial use, with the condition of providing full attribution to the original publication.
