Open Access

Content Validity and Cognitive Testing in the Development of a Motivational Interviewing Self-Assessment Questionnaire

Tadeja HOČEVAR

Tadeja HOČEVAR

National Institute of Public HealthLjubljana, Slovenia
Orcid profile
Search for this author on
Sciendo|Google Scholar
HOČEVAR, Tadeja
, 
Tim ANSTISS

Tim ANSTISS

University of Reading, Henley Business SchoolUnited Kingdom
Orcid profile
Search for this author on
Sciendo|Google Scholar
ANSTISS, Tim
 and 
Danica ROTAR PAVLIČ

Danica ROTAR PAVLIČ

University of Ljubljana, Medical Faculty, Department of Family MedicineLjubljana, Slovenia
Orcid profile
Search for this author on
Sciendo|Google Scholar
ROTAR PAVLIČ, Danica
  
Jan 03, 2024
Content Validity and Cognitive Testing in the Development of a Motivational Interviewing Self-Assessment Questionnaire's Cover Image
About this article
Previous Article
Next Article
Cite
Download Cover
Article Category: Original scientific article
Published Online: Jan 03, 2024
Page range: 46 - 54
Received: Oct 05, 2023
Accepted: Nov 28, 2023
DOI: https://doi.org/10.2478/sjph-2024-0007
Keywords
© 2024 Tadeja HOČEVAR et al., published by Sciendo
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Figure 1.

Stages and steps in testing the content validity of the MI practice self-assessment questionnaire. Legend: [] – numbers in brackets define steps in testing content validity;MIQ 1.0/2.=/3.0 – version of MI questionnaire
Stages and steps in testing the content validity of the MI practice self-assessment questionnaire. Legend: [] – numbers in brackets define steps in testing content validity;MIQ 1.0/2.=/3.0 – version of MI questionnaire

The content validity of the measurement instrument as a whole and by specific MI elements, with the universal agreement of experts (S-CVI-UA)_

MI scale/element S-CVI-Ave1
RELEVANCE of the question UNDERSTANDABILITY of the question COMPLETENESS of response options MEANINGFULNESS of response options
Scale as a whole 0.99 0.93 0.98 0.98
Partnership 1.00 0.86 0.94 0.94
Acceptance 0.97 0.73 0.97 0.97
Evoking 0.96 1.00 1.00 1.00
Resisting the righting reflex 1.00 0.94 0.95 0.97
Strengthening self-efficacy 1.00 0.95 1.00 1.00

Values of the validity index for individual items (I-CVI) and the modified kappa coefficient (k*) for 27 items_

MI element Item code* and content RELEVANCE of the question UNDERSTANDABILITY of the question COMPLETENESS of response options MEANINGFULNESS of response options
N1(exp3-4) I-CVI2 Pc3 k*4 N1(exp3-4) I-CVI2 Pc3 k*4 N1(exp3-4) I-CVI2 Pc3 k*4 N1(exp3-4) I-CVI2 Pc3 k*4
PARTNERSHIP P1 make P/C5 feel comfortable 6 1.00 0.000 1.00 5 0.83 0.094 0.67 5 0.83 0.094 0.67 5 0.83 0.094 0.67
P2 being supportive 6 1.00 0.000 1.00 5 0.83 0.094 0.67 5 0.83 0.094 0.67 5 0.83 0.094 0.67
P3 working together 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
P4 P/C’s input 6 1.00 0.000 1.00 4 0.67 0.234 0.33 6 1.00 0.000 1.00 6 1.00 0.000 1.00
P5 incorporate P/C’s ideas 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
P6 be there in case P/C changes their mind 6 1.00 0.000 1.00 5 0.83 0.094 0.67 6 1.00 0.000 1.00 6 1.00 0.000 1.00
ACCEPTANCE A1 P/C’s view is relevant 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
A2 strive to understand 6 1.00 0.000 1.00 5 0.83 0.094 0.67 5 0.83 0.094 0.67 5 0.83 0.094 0.67
A3 P/C’s choice to change 6 1.00 0.s000 1.00 5 0.83 0.094 0.67 6 1.00 0.000 1.00 6 1.00 0.000 1.00
A4 respect P/C’s decision 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
A5 P/C’s personal growth 5 0.83 0.094 0.67 4 0.67 0.234 0.33 6 1.00 0.000 1.00 6 1.00 0.000 1.00
EVOKING E2 P/C’s own reasons 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
E3 P/C’s own strategies 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
E4 encourage P/C’s thinking 5 0.83 0.094 0.67 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
E5 P/C’s inner strenghts and sources 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
RESISTING THE RIGHTING REFLEX R1* explaining without first exploring 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
R2* talking about own knowing 6 1.00 0.000 1.00 5 0.83 0.094 0.67 5 0.83 0.094 0.67 5 0.83 0.094 0.67
R3* reasons without permission and inquire 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
R4* ideas without permission and inquire 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
R5* talk P/C into 6 1.00 0.000 1.00 5 0.83 0.094 0.67 6 1.00 0.000 1.00 6 1.00 0.000 1.00
R6 suggestions after permission and inquire 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
STRENGTHENING SELF-EFFICACY S1 ask about confidence 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
S2 ask about needed 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
S3 P/C’s past experiences 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
S5 affirmations 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
S6 change talk 6 1.00 0.000 1.00 5 0.83 0.094 0.67 6 1.00 0.000 1.00 6 1.00 0.000 1.00
S8 other resources 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00 6 1.00 0.000 1.00
Language:
English
Publication timeframe:
4 times per year
Journal Subjects:
Medicine, Clinical Medicine, Hygiene and Environmental Medicine
Journal RSS Feed