ORIGINAL ARTICLE
Kazuhiro MIYATA, PhD, PT1, Shuntaro TAMURA, PhD, PT2, Sota KOBAYASHI, MSc, PT3,4, Ren TAKEDA, PT4,5 and Hiroki IWAMOTO, MSc, PT6
From the 1Department of Physical Therapy, Ibaraki Prefectural University of Health Science, 2Department of Rehabilitation, Fujioka General Hospital, 3Department of Rehabilitation, Public Nanokaichi Hospital, 4Department of Rehabilitation Sciences, Gunma University Graduate School of Health Sciences, 5Department of Rehabilitation, Numata Neurosurgery & Heart Disease Hospital and 6Department of Rehabilitation Center, Hidaka Rehabilitation Hospital, Gunma, Japan.
Objectives: After confirming the measurement properties of the Berg Balance Scale (BBS) in patients with stroke by conducting a Rasch analysis, this study sought: (i) to generate a keyform as a tool for goal-setting and intervention-planning; and (ii) to determine the appropriate strata for separating patients’ postural balance ability.
Design: Methodological analyses of cross-sectional study data.
Patients: A pooled sample of 156 patients with stroke: mean (standard deviation) age 74.4 (12.9) years.
Methods: This study evaluated the BBS’s rating scale structure, unidimensionality, and measurement accuracy (0: unable to perform or requiring help, to 4: normal performance) and then generated a keyform and strata.
Results: The BBS rating scale fulfilled the category functioning criteria. Principal component analysis of standardized residuals confirmed the unidimensionality of the test. All items fit the Rasch analysis. Person ability-item difficulty matching was good. Person reliability was 0.96, and the patients were divided into 9 strata. The keyform for the BBS will enable clinicians and investigators to estimate patients’ postural balance ability and monitor their progress.
Conclusion: The BBS has strong measurement properties. This study generated both a keyform that can contribute to clinicians’ decision-making in goal-setting and intervention-planning and strata that can facilitate understanding of patients’ abilities.
People who have had a stroke often have difficulty maintaining postural balance and controlling their posture. The Berg Balance Scale (BBS) measures a person’s ability to maintain postural balance. Several analyses were performed to investigate the measurement properties of the BBS in patients who have had a stroke. Then, a keyform tool was generated and some strata (levels) determined that separate patients according to postural balance ability. A keyform can help therapists to identify items that a patient finds relatively difficult. Use of a keyform can contribute to both rehabilitation goal-setting and planned interventions for patients. The strata can be used to detect and measure changes in a patient’s postural balance ability. The findings of this study demonstrate that the BBS has strong measurement properties and provides an appropriate keyform and 9 strata. Use of these tools can facilitate the rehabilitation of patients with stroke through quantification of a patient’s postural balance ability.
Key words: rehabilitation; postural balance; Rasch analysis; outcome measure; goal-setting; intervention-planning.
Citation: J Rehabil Med 2022; 54: jrm00359. DOI: http://dx.doi.org/10.2340/jrm.v54.4443
Copyright: © Published by Medical Journals Sweden, on behalf of the Foundation for Rehabilitation Information. This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (https://creativecommons.org/licenses/by-nc/4.0/)
Accepted: Nov 3, 2022; Published: Dec 9, 2022
Correspondence address: Kazuhiro Miyata, Department of Physical Therapy, Ibaraki Prefectural University of Health Science, 4669-2, Ami-Machi, Inashiki-gun, Ibaraki, 300-0394 Japan. E-mail:miyatak@ipu.ac.jp
Competing interests and funding: The authors have no conflicts of interest to declare.
Measuring and monitoring the postural balance and risk of falling in individuals who have had a stroke are critical to helping maintain their mobility and their activities of daily living (ADL) (1, 2). Suitable interventions to improve an individual’s diminished postural balance can be devised, based on an accurate assessment of their postural balance (3). An effective postural balance assessment scale as a core outcome set is essential to determine the effectiveness of rehabilitation interventions. One of the most widely used outcome measures is the Berg Balance Scale (BBS) (4), the measurement properties of which have been analysed in detail in stroke patients by using classical test theory (5). It has been pointed out that floor and ceiling effects are likely to be obtained with the BBS (5); however, the BBS is recommended in neurological disorder guidelines for use as part of a core outcome set to achieve the goals of improving static and dynamic sit-to-stand postural balance (6). BBS results have also been used as clinical trial outcomes (7).
The BBS aggregate score has limited clinical interpretability, because it does not indicate which of the scale’s items were easy, difficult, or optimally challenging for subjects (8–12). One way to obtain more information for interpreting BBS results is to examine both the overall score and the responses to individual test items. Rasch analysis is a model-driven process; it can assess how well a given test item performs in terms of its relevance or usefulness for measuring the underlying construct (13). Rasch analysis can assess aspects of a scale, such as dimensionality, item fit, item difficulty and person ability, and reliability; and, whether the data obtained fit the Rasch model. Rasch analysis provides a framework and method for enhancing the clinical interpretability of evaluations through output termed a “keyform” and “strata” (14).
A keyform is used to assist goal-setting and intervention-planning by drawing attention to missing items that correspond to items that examinees find difficult to complete (15–17). Strata are used to create a conversion table that transforms the raw scores of a scale into Rasch-based interval level measurements and then divides them into statistically detectable groups (18, 19).
The aims of the current study were two-fold. After the study confirmed that the BBS data obtained herein fit the Rasch model, the first goal was to generate a BBS keyform that enables therapists to compare each patient’s response with the response predicted by the Rasch model and to highlight specific items or tasks that are relatively difficult for the individual. This can assist in rehabilitation goal-setting and intervention-planning. The second goal was to generate strata with a conversion table to statistically detect changes in patients’ postural balance ability.
This was a multicentre clinical observational study of individuals with subacute stroke who participated in a rehabilitation programme at the convalescent rehabilitation wards of 3 hospitals in Japan during April 2018 to May 2020. Inclusion criteria were: (i) diagnosis with a cerebral haemorrhage or cerebral infarction; (ii) first-ever supratentorial hemispheric lesion; and (iii) stable medical condition. Exclusion criteria were: (i) any neurological or musculoskeletal disorder; (ii) a missing BBS score on admission or at discharge; (iii) unable to follow the indicated behaviour; or (iv) declined to be included in the study.
The study was approved by the Ethics Review Committee of Fujioka General Hospital, Public Nanokaichi Hospital, and Hidaka Rehabilitation Hospital (approval numbers #194, #20200020, #20200503, respectively) and was conducted in compliance with the Declaration of Helsinki. Because the study was a retrospective observational analysis and used only existing data, the patients’ written or verbal consent was not required and was not obtained. To provide the patients with the opportunity to decline being part of the study, an opt-out option for study information was posted on each hospital’s website or bulletin board.
The BBS is postural balance scale containing 14 items including standing and sitting unsupported, reaching forward, and placing the alternating foot on a stool. Administering the BBS takes approximately 15 min. Each of the 14 items are scored on a 5-level ordinal scale from 0 (“unable to perform or requiring help”) to 4 (“normal performance”), thus providing a potential maximum score of 56 points (4). A review of the measurement properties of the BBS showed them to be valid and reliable (5).
The patients’ demographic and clinical characteristics were collected from their medical records and the rehabilitation centres’ databases. The BBS was administered to each patient by a well-trained physical therapist as part of the routine clinical assessment at the patient’s admission to and discharge from the convalescent rehabilitation ward. Data from the patients’ admission evaluations were used for the main analysis, and data from the patients’ discharge session were used to assess the differential item functioning (DIF) related to the interventions provided to the patients.
Rasch analysis of the BBS items was conducted according to the framework of the Rasch Reporting Guidelines in Rehabilitation Research (RULER) (20, 21). The Rasch model is a probabilistic, mathematical model that provides an opportunity to transform ordinal scales into interval-like scores to account for differences in item difficulty and differences across categories in an ordinal response scale. The current study sample size (n = 156), item calibration, and person measures were expected to be stable within 0.5 logits with a 99% confidence interval (22). The patients’ data were analysed using WINSTEPS software (ver. 5.2.3; Winsteps Rasch measurement computer program, Beaverton, OR, USA).
This study examined the following measurement properties based on the RULER guidelines to investigate whether the pattern of the patients’ responses met the assumptions of the Rasch model:
The patient selection flow chart is shown in Fig. 1. The patients’ (n = 156) main clinical and demographic characteristics are summarized in Table I.
Fig. 1. Enrolment process flow chart. BBS: Berg Balance Scale.
For the Rasch analysis:
Fig. 2. Person-item map of the Berg Balance Scale (BBS). The numbers (−8 to 9) on the left side of the figure represent the logits. Along the vertical line, M=mean, S=1 standard deviation, and T=2 standard deviations. Left side of the vertical line represents the person ability (×); right side represents the item difficulty for each item of the BBS, both in logits. Each “×” represents a single person.
Fig. 3. Example of clinical use of the keyform in a representative patient with a Berg Balance Scale (BBS) score of 40 points. Latent trait (balance ability) increases toward the right of the graph. The threshold map for each of the items (listed in descending order of difficulty) is in the middle of the figure. Marking a vertical line that starts from the patient’s global score (here, 40 points), the point where this line intersects the rating zones for each item (0–4) indicates the score most probable for that item. The threshold between adjacent categories is marked with “ | “. The bottom 2 lines contain the Rasch nomogram, which allows the conversion of the total raw score into a logit measure (centred at the mean item difficulty).
This study evaluated the measurement properties of the BBS by performing Rasch analysis to determine the suitability of each item of the BBS as a general tool in the assessment of patients’ postural balance. The results of the measurement evaluation show that the BBS provides valid and reliable measures of stroke postural balance, and a keyform and strata were developed as tools to support decision-making.
In the stroke patients in this study, the BBS was unidimensional as a postural balance assessment scale; it fulfilled all of the criteria of the rating scale and was highly reliable, and all items were fitted to the Rasch model. These findings are generally consistent with studies of the use of the BBS for patients with subacute and chronic stroke (8) or Parkinson’s disease (9) and community-dwelling older adults (12). Although it has been pointed out that the ceiling effect and rating redundancy can be obtained easily with the BBS (3), the findings of the current study confirm that the BBS with strong psychometric properties can be used as part of a core outcome set to measure postural balance in specific stroke patients (e.g. excluding very mild and severe strokes).
Adequate interpretations of test results and high clinical utility are critical in rehabilitation. This study approached the issue of clinical interpretability by linking the qualitative content of the BBS (the postural balance tested by each item) to its quantitative aspects (item ratings) via a new scoring method, the keyform. Earlier studies of keyforms focused on the evaluation of upper extremity function (16, 24) in patients with stroke and demonstrated the application of keyforms in clinical practice.
A keyform is a pencil-and-paper scoring template on which a therapist records item ratings and then examines the pattern of item responses (15, 16). A keyform as used herein can be used in 2 ways to support clinical decision-making. The first is to ensure that each examinee presents a pattern of item responses that matches the expectations of the model, thus facilitating the detection of unexpected responses. The second is to assist in goal-setting and treatment planning to call attention to missing items that correspond to items that examinees find difficult to complete. To the best of our knowledge, there is a BBS keyform only for community-dwelling older adults (17), and there is no BBS keyform to measure a patient’s postural balance after stroke.
This study has shown how clinicians can design interventions using the BBS keyform. As shown in the example, the therapist can use the keyform to plan an intervention, by first administering the BBS and then circling the patient’s item ratings on the keyform. Next, the therapist finds the transition zone on the BBS keyform. It occurs above easier items on which patients show high performance (rating = 3 or 4) and below more difficult items on which the patients show limited performance (rating = 1 or 2) or the inability to perform (rating = 0). Items in this transition zone represent the expected next steps as patients transition from their current skill level to a higher skill level.
For example, the patient with a moderately severe postural balance deficit represented in Fig. 3 achieved high ratings on easy items and lower ratings on more difficult items, and had fluctuating ability on moderately difficult items, represented by a region of back-and-forth ratings in the middle of the keyform. The BBS items within this zone are neither too easy nor too difficult and indicate postural balance ability at the “just right” challenge level. Postural balance tasks (items) within the transition zone suggest appropriate short-term goals, and exercise actions (items) beyond the transition zone may form the basis for appropriate long-term goals.
The Rasch analysis in this study demonstrated that the BBS was highly reliable and that the examinees could be divided into 9 strata; the range of scores for each stratum was 4–8 points. This score range is also larger than the BBS’s minimal detectable change (MDC) 3 – 5 points for patients with stroke (25, 26), except for a single stratum. This suggests that the difference in strata exceeds the measurement error. The cut-off points of the BBS for stroke patients were 42 points for the ability to walk around the household (27) and 47–51 points for fall prediction (28, 29). Thus, if an examinee’s postural balance ability belongs to the either of the upper 2 strata, he or she may be at low risk of falling.
The results of the current study show that the stability of the BBS item hierarchy was robust in DIF analysis. In particular, the finding of no DIF for the intervention means that the BBS can be used safely to compare an individual’s postural balance before and after interventions, thus increasing the chance of drawing the correct conclusions about the effectiveness of interventions. A similar recent analysis of the Falls Efficacy Scale – International suggested that there were no items of DIF before and after rehabilitation (30). There is growing evidence that scales validated by Rasch analysis are more valid than scores validated by classical test theory (31, 32). Rasch analysis can also be used to test the robustness of items to changes in the ordinal score (e.g. before and after intervention) and may provide information about the choice of scales.
This study has some limitations. The study did not evaluate the patients’ data collected by the 3 hospitals or the intra-hospital reliability. However, the BBS was regularly conducted at each hospital by well-trained physical therapists who had participated in in-hospital training. The keyform is less useful for examinees with very high/low ability, because there is greater measurement error at these extremes due to floor/ceiling effects. In addition, as with all statistical values, the locations of transition-zone boundaries and the determination of short- and long-term goals are imprecise, and the resulting intervention suggestions are hypothetical. It is now necessary to determine whether interventions generated through the new keyform are more effective than traditionally induced clinical interventions.
The findings of this study indicate that the BBS has strong measurement properties. A keyform and strata that can be used with this scale were developed (Fig. S2). A keyform can be used to quickly compare response patterns from a clinical examination with those from Rasch analysis, which may help therapists use the BBS as a postural balance assessment scale in clinical practice to aid decision-making in goal-setting and intervention-planning. Moreover, as the conversion table and strata become clear, the postural balance ability of the tested patients could be better understood.