<abstract xmlns="http://www.w3.org/1999/xhtml">

<sec>
<h3>Aim</h3>
<p>To develop and content validate a self-assessment questionnaire on motivational interviewing (MI) practice as the first stages in forming the questionnaire to be used in cross-sectional studies involving practitioners conducting the MI-based alcohol screening and brief intervention (ASBI).</p>
</sec>
<sec>
<h3>Methods</h3>
<p>A comprehensive mixed methods approach included a literature review, 3 rounds of expert panel (EP) opinions (n=10), cognitive testing (CT) with 10 MI-based ASBI practitioners, and questionnaire piloting with 31 MI-based ASBI practitioners. Based on the EP opinions in the second round, content validity indices (CVIs) and the modified kappa coefficient (k*) were calculated, focusing on the relevance and understandability of questions and comprehensiveness and meaningfulness of the response options. This analysis was performed in 2020, at the conclusion of the national “Together for a Responsible Attitude Towards Alcohol Consumption” (“Skupaj za odgovoren odnos do pitja alkohola”, SOPA) project’s pilot implementation.</p>
</sec>
<sec>
<h3>Results</h3>
<p>On a scale level, CVI values based on universal agreement for the entire questionnaire were high for 3/4 categories (S-CVI-UA>0.80), and CVI values based on average agreement were high across all categories (S-CVI-Ave>0.90). At the item level, CVI values (I-CVI) were never &lt;0.50 (automatic item rejection), and the modified kappa value (k*) indicated poor validity for two items in the understandability category (k*=0.33). All problematic parts of the questionnaire were further tested and successfully modified based on the results of CT, and accepted in the third round of testing.</p>
</sec>
<sec>
<h3>Conclusions</h3>
<p>The final version of the questionnaire demonstrated appropriate content validity for use in studies among Slovenian MI-based ASBI practitioners and is now ready for further psychometric testing.</p>
</sec>
</abstract>

Aim
To develop and content validate a self-assessment questionnaire on motivational interviewing (MI) practice as the first stages in forming the questionnaire to be used in cross-sectional studies involving practitioners conducting the MI-based alcohol screening and brief intervention (ASBI).


Methods
A comprehensive mixed methods approach included a literature review, 3 rounds of expert panel (EP) opinions (n=10), cognitive testing (CT) with 10 MI-based ASBI practitioners, and questionnaire piloting with 31 MI-based ASBI practitioners. Based on the EP opinions in the second round, content validity indices (CVIs) and the modified kappa coefficient (k*) were calculated, focusing on the relevance and understandability of questions and comprehensiveness and meaningfulness of the response options. This analysis was performed in 2020, at the conclusion of the national “Together for a Responsible Attitude Towards Alcohol Consumption” (“Skupaj za odgovoren odnos do pitja alkohola”, SOPA) project’s pilot implementation.


Results
On a scale level, CVI values based on universal agreement for the entire questionnaire were high for 3/4 categories (S-CVI-UA>0.80), and CVI values based on average agreement were high across all categories (S-CVI-Ave>0.90). At the item level, CVI values (I-CVI) were never <0.50 (automatic item rejection), and the modified kappa value (k*) indicated poor validity for two items in the understandability category (k*=0.33). All problematic parts of the questionnaire were further tested and successfully modified based on the results of CT, and accepted in the third round of testing.


Conclusions
The final version of the questionnaire demonstrated appropriate content validity for use in studies among Slovenian MI-based ASBI practitioners and is now ready for further psychometric testing.

Content Validity and Cognitive Testing in the Development of a Motivational Interviewing Self-Assessment Questionnaire

Slovenian Journal of Public Health

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

VSEBINSKA VELJAVNOST IN KOGNITIVNO TESTIRANJE PRI RAZVOJU SAMO-OCENJEVALNEGA VPRAŠALNIKA O MOTIVACIJSKEM INTERVJUJU

Aim
To develop and content validate a self-assessment questionnaire on motivational interviewing (MI) practice as the first stages in forming the questionnaire...

Content Validity and Cognitive Testing in the Development of a Motivational Interviewing Self-Assessment Questionnaire

Article Category: Original scientific article

Published Online: Jan 03, 2024

Page range: 46 - 54

Received: Oct 05, 2023

Accepted: Nov 28, 2023

DOI: https://doi.org/10.2478/sjph-2024-0007

Keywords
Alcohol screening and brief intervention, Cognitive testing, Content validity, Motivational interviewing, Self-assessment questionnaire

© 2024 Tadeja HOČEVAR et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Content Validity and Cognitive Testing in the Development of a Motivational Interviewing Self-Assessment Questionnaire

Article Category: Original scientific article

Published Online: Jan 03, 2024

Page range: 46 - 54

Received: Oct 05, 2023

Accepted: Nov 28, 2023

DOI: https://doi.org/10.2478/sjph-2024-0007

KeywordsAlcohol screening and brief intervention, Cognitive testing, Content validity, Motivational interviewing, Self-assessment questionnaire

© 2024 Tadeja HOČEVAR et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Keywords
Alcohol screening and brief intervention, Cognitive testing, Content validity, Motivational interviewing, Self-assessment questionnaire