Teacher judgments of student achievement influence how effectively students learn and how teachers organize their lessons. Teachers’ diagnostic competence is therefore an important field of research for subject-specific teaching and learning. This study investigates how pre-service English teachers assess complex learner essays using assessment rubrics. In particular, it explores whether instructional videos are effective in minimizing distortion effects in essay assessment by raising participants’ awareness about them. English pre-service teachers (