Assessment of agreement in measuring orthodontic treatment need with the modified DHC
Published Online: Dec 13, 2023
Page range: 10 - 14
Received: Aug 01, 2007
Accepted: Dec 01, 2007
DOI: https://doi.org/10.2478/aoj-2008-0003
© 2008 Alireza Akbarzadeh Bagheban et al., published by Sciendo
This work is licensed under the Creative Commons Attribution 4.0 International License.
Aims
To determine senior dental students’ validity, reliability and category distinguishability when using the Dental Health Component (DHC) of the Index of Orthodontic Treatment Need (IOTN).
Methods
Randomly selected pretreatment dental casts of 42 patients were used. The casts were assessed by six senior dental students after a 4-day training period and three orthodontists using the modified Dental Health Component (DHC) of the Index of Orthodontic Treatment Need (IOTN). Validity and reliability in assessing the DHC were measured using kappa and the category distinguishability with two modified association models: square scores association model and the agreement plus square scores association model.
Results
The students’ mean validity was 0.67 and their mean reliability was 0.65. For two students the better model was the square scores association model (Categories 1 and 2: Mean 0.48; Categories 2 and 3: Mean 0.84). For four students the agreement plus square scores association model was the better model (Categories 1 and 2: Range: 0.90–0.99; Categories 2 and 3: 0.93–0.99)
Conclusion
In order to more precisely assess the reliability and validity of ordinal scales and the pattern of agreement between examiners association models should be used in addition to kappa.