Range of kappa values | Interpretation of the degree of agreement |
---|---|
<0,00 | poor |
0.00–0.20 | slight |
0.21–0.40 | fair |
0.41–0.60 | moderate |
0.61–0.80 | substantial |
0.81–1.00 | almost perfect |
Basha 2019 | Dobruch- Sobczak 2019 | Itani 2019 | Lam 2019 | Pang 2019 | Persichetti 2020 | Phuthharak 2019 | Seifert 2020 | Wildman-Tobriner 2020 | |
---|---|---|---|---|---|---|---|---|---|
380 | 20 | 180 | 463 | 189 | 100 | 108 | (40 80 + 40) | 100 | |
3 | 5 | 4 | 3 | 2 | 7 | 2 | 4 | 15 | |
Fleiss’ κ | Cohen’s κ | Cohen’s κ | Randolph’s κ | Cohen’s κ | Cohen’s κ | Cohen’s κ | Fleiss’ κ | Fleiss’ κ | |
0.636 | 0.55 | 0.43 | 0.66 | 0.10–0.643 | 0.53 | 0.616 | S1: 0.476 S2: 0.674 | 0.39 | |
0.750 | 0.48–0.501 | 0.252 | 0.35 | 0.24–0.534 | 0.47 | 0.327 | S1: 0.440 S2: 0.622 | 0.39 | |
0.868 | – | 0.30 | – | 0.28 | 0.47 | – | S1: 0.537 S2: 0.676 | 0.38 | |
0.524 | 0.39 | 0.23 | 0.50 | 0.07–0.145 | 0.33 | 0.143 | S1: 0.431 S2: 0.796 | 0.18 | |
–2 | 0.41 | – | – | 0.50 | – | – | – | – | |
0.598 | – | – | 0.77 | – | – | 0.288 | – | – | |
0.957 | 0.57 | 0.27 | – | 0.39 | 0.47 | – | – | 0.28 | |
0.974 | 0.61 | 0.49 | – | – | 0.38 | – | – | 0.41 | |
0.604 | – | 0.39 | – | 0.33 | 0.65 | – | – | 0.26 | |
– | – | 0.38 | – | – | – | – | S1: 0.405 S2: 0.424 | – | |
0.885 | – | 0.06 | – | – | 0.11 | – | – | 0.08 | |
0.211 | 0.34 | – | – | – | 0.46 | – | – | – | |
1.000 | 0.40 | – | 0.82 | 0.24 | – | – | – | – |
T-SWE | VTIQ | 2D-SWE | |
---|---|---|---|
0.77 (0.70–0.83) | 0.72 (0.67–0.77) | 0.63 (0.59–0.66) | |
0.76 (0.72–0.81) | 0.81 (0.78–0.84) | 0.81 (0.79–0.83) | |
0.84 | 0.85 | 0.88 |