Official Journal of the Italian Society of Orthopaedics and Traumatology
Table 4 Level of agreement among observers for the AO/OTA 2018 classification with the universal modifiers and qualifications after both review sessions
AO/OTA 2018 (with universal modifiers and qualifications) | Observers | % agreement | Kappa (95% CI) | Judgement |
|---|---|---|---|---|
First reading | 1 versus 2 | 53.4% | 0.48 (0.382–0.578) | Moderate agreement |
1 versus 3 | 79.3% | 0.767 (0.685–0.849) | Substantial agreement | |
2 versus 3 | 70.7% | 0.673 (0.581–0.764) | Substantial agreement | |
Mean | 67.8% | 0.660 (0.382–0.849) | Substantial agreement | |
Second reading | 1 versus 2 | 52.6% | 0.472 (0.375–0.569) | Moderate agreement |
1 versus 3 | 77.6% | 0.748 (0.664–0.832) | Substantial agreement | |
2 versus 3 | 68.1% | 0.644 (0.551–0.737) | Substantial agreement | |
Mean | 66.1% | 0.621 (0.375–0.832) | Substantial agreement |