<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Rubrics are defined as coherent sets of criteria for students’ work that include detailed descriptions of quality for a specific learning task. They are used in different subjects to guide student learning and assess its results. This study demonstrates the design and development of an assessment rubric for writing emails in English as a foreign language (EFL). As English emails are a key form of communication in the globalised world, it is essential to have a rubric which is both fit for classroom use and empirically validated. In our study, six raters were trained to assess a sample of N = 1017 emails from learners at lower secondary level in Switzerland. We evaluate the reliability of the ratings by assessing inter-rater agreement after a period of training and by comparing their scores to those of an expert rater. Further, we analyse the linguistic quality of learner texts by focusing on four key markers of emails and compare this analysis to our rubric based scores to analyse its face validity. Our results show high reliability and validity of the rubric. We discuss the potential of such rubrics to improve teaching quality in various subjects and learning domains.</p>
</abstract>

Rubrics are defined as coherent sets of criteria for students’ work that include detailed descriptions of quality for a specific learning task. They are used in different subjects to guide student learning and assess its results. This study demonstrates the design and development of an assessment rubric for writing emails in English as a foreign language (EFL). As English emails are a key form of communication in the globalised world, it is essential to have a rubric which is both fit for classroom use and empirically validated. In our study, six raters were trained to assess a sample of N = 1017 emails from learners at lower secondary level in Switzerland. We evaluate the reliability of the ratings by assessing inter-rater agreement after a period of training and by comparing their scores to those of an expert rater. Further, we analyse the linguistic quality of learner texts by focusing on four key markers of emails and compare this analysis to our rubric based scores to analyse its face validity. Our results show high reliability and validity of the rubric. We discuss the potential of such rubrics to improve teaching quality in various subjects and learning domains.

Designing and validating an assessment rubric for writing emails in English as a foreign language

Research in Subject-matter Teaching and Learning (RISTAL)

This work is licensed under the Creative Commons Attribution 4.0 International License.

Rubrics are defined as coherent sets of criteria for students’ work that include detailed descriptions of quality for a specific learning task. They are used...

Designing and validating an assessment rubric for writing emails in English as a foreign language

Publié en ligne: 27 mars 2023

Pages: 16 - 48

DOI: https://doi.org/10.2478/ristal-2023-0002

Mots clés
English as a foreign language, Writing, Assessment, Rubrics, Emails

© 2023 Stefan D. Keller et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Designing and validating an assessment rubric for writing emails in English as a foreign language

Publié en ligne: 27 mars 2023

Pages: 16 - 48

DOI: https://doi.org/10.2478/ristal-2023-0002

Mots clésEnglish as a foreign language, Writing, Assessment, Rubrics, Emails

© 2023 Stefan D. Keller et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Mots clés
English as a foreign language, Writing, Assessment, Rubrics, Emails