Intra- and Inter-Rater Reliability of Features of Movement Commonly Associated with Movement Competency

Abstract

Movement screening tools, such as the Functional Movement ScreenTM and the Movement Competency Screen, are commonly used to assess fundamental movement patterns. These movement patterns, such as squatting and lunging, serve as the foundation for human movement, essential for daily living and athletic performance. By assessing an individual’s ability to control their joints during fundamental movements, screens help identify potential areas for improving performance and reducing injury risk. However, existing screens are limited. They do not adequately assess movement competency, the ability to move competently, without limitation or impairment, under different task demands (e.g., varying loads or speeds).

The Physical Literacy ScreenTM (PLS) was developed to more comprehensively assess movement competency. Unlike previous screens, the PLS considers how different task demands (e.g., varying load or speed) influence how movers control key movement features, to inform exercise, education, and coaching recommendations based on a more thorough understanding of an individual’s movement abilities. Because PLS feature scoring relies entirely on visual observation, the reliability of judging these features must be established before the framework can be applied with confidence. Therefore, the purpose of this study is to determine the intra-rater and inter-rater reliability of visually assessing key movement features commonly associated with movement competency. This study examined the reliability of raters visually judging three key movement features, knee control, back control, and shoulder control, using standardized video recordings of athletes performing PLS-derived tasks. Twenty-two kinesiology students independently assessed pre-recorded videos of varsity volleyball athletes and re-scored the same videos at least 14 days later. Intra-rater reliability was measured using Cohen’s Kappa, and inter-rater reliability using Fleiss’ Kappa.

Results showed moderate intra-rater reliability for Knee (κ = 0.42) and Back (κ = 0.47) features and fair reliability for Shoulder (κ = 0.28). Inter-rater was poor across all features, with Fleiss’ Kappa values below zero.

The study provides initial reliability evidence for the visual judgment of key movement features using PLS-derived tasks. These findings highlight the importance of refining feature definitions, improving rater training and calibration procedures, and clarifying scoring criteria to enhance consistency. Strengthening these elements may support more reliable use of visual movement assessments in sport, education, and health contexts.