Indicator | Cluster 1 (n = 45) | Cluster 2 (n = 77) | Cluster 3 (n = 81) | Post hoc test (Games–Howell) | ||||
---|---|---|---|---|---|---|---|---|
Mean | SD | Mean | SD | Mean | SD | p < 0.05 | ||
Preference (ranking of preference) | ||||||||
Face-to-face lectures | 1.82 | 1.614 | 1.82 | 1.325 | 0.20 | 0.534 | C1 ≠ C3 |
|
Face-to-face lectures + Web lectures | 3.76 | 1.264 | 3.53 | 0.912 | 1.37 | 0.678 | C1 ≠ C3 |
|
Web lectures + quizzes | 3.22 | 1.580 | 3.34 | 1.314 | 3.47 | 1.215 | No significant |
|
Web lectures + discussion boards | 1.76 | 0.916 | 4.18 | 0.854 | 3.69 | 1.103 | C1 ≠ C3; C1 ≠ C2 |
|
Knowledge clips + quizzes | 2.87 | 1.160 | 0.55 | 0.640 | 3.05 | 1.213 | C1 ≠ C2 |
|
Knowledge clips + discussion boards | 1.58 | 1.559 | 1.50 | 1.056 | 3.22 | 1.378 | C1 ≠ C3 |
|
Usage (frequency of access) | ||||||||
Web lectures | 28.69 | 14.318 | 38.16 | 16.691 | 34.86 | 15.657 | C1 ≠ C2 | |
Quizzes | 7.67 | 5.568 | 10.18 | 4.814 | 9.44 | 5.341 | C1 ≠ C2 | |
MOOC/knowledge clips | 13.71 | 6.858 | 17.70 | 9.750 | 16.38 | 7.835 | C1 ≠ C2 | |
Discussion boards | 18.71 | 22.001 | 31.52 | 32.908 | 19.65 | 19.956 | C1 ≠ C2 |
Student ID | Preference of materials | Usage of materials | Performance in the course |
---|---|---|---|
Ranking among 6 combinations of materials (6 indicators) | Frequency of access to 4 separate types of materials (4 indicators) | Assignment and final examination raw scores (8 indicators) | |
e.g. Student 1 | Lec = 0 |
Web = 30 |
Assignments: |
Type of material | Description | Indicators of use |
---|---|---|
Web lectures | The teachers give presentations of learning contents with visual aids (PowerPoint slides, Excel spreadsheets, etc.) in Dutch. The lectures are recorded by the teachers then uploaded onto Toledo for students to watch freely. | Number of clicks |
MOOC/knowledge clips | The teachers provide short videos that explain learning contents in Dutch/English. Students click onto the given links to be directed to an external Website such as YouTube (knowledge clips) or edX (MOOC) instead of staying on Toledo. | Number of clicks |
Discussion boards (Q&A) | Students post questions on the common discussion board. The teachers and other students can reply to the posts to answer and/or elaborate. The Q&A can be in Dutch or English. | Number of posts created |
Online quizzes | The teachers create quizzes on Toledo for students to test their understanding of learning contents on their own accord. The quizzes are in English. | Number of attempts |
Combinations of study materials | Number of students | Ranking of preference | |||
---|---|---|---|---|---|
Minimum | Maximum | Mean | Std. deviation | ||
Face-to-face lectures | 203 | 0 | 5 | 1.17 | 1.405 |
Face-to-face lectures + Web lectures | 203 | 0 | 5 | 2.72 | 1.437 |
Web lectures + quizzes | 203 | 0 | 5 | 3.36 | 1.337 |
Web lectures + discussion boards | 203 | 0 | 5 | 3.45 | 1.350 |
Knowledge clips + quizzes | 203 | 0 | 5 | 2.06 | 1.563 |
Knowledge clips + discussion boards | 203 | 0 | 5 | 2.24 | 1.533 |
Material | Number of content items | Number of students | Number of views/clicks/attempts | |||
---|---|---|---|---|---|---|
Mean | Std. deviation | Mean per item | Std. deviation | |||
Web lectures | 14 | 203 | 34.74 | 16.099 | 2.48 | 1.150 |
Quizzes | 6 | 203 | 9.33 | 5.260 | 1.56 | 0.877 |
MOOC/clips | 6 | 203 | 16.29 | 8.518 | 2.72 | 1.420 |
Discussion boards | 38 | 203 | 23.95 | 26.570 | 0.63 | 0.699 |