1. bookVolumen 14 (2022): Heft 1 (June 2022)
16 Apr 2015
2 Hefte pro Jahr
access type Uneingeschränkter Zugang

Using learning analytics to support STEAM students’ academic achievement and self-regulated learning

Online veröffentlicht: 08 Jun 2022
Volumen & Heft: Volumen 14 (2022) - Heft 1 (June 2022)
Seitenbereich: 36 - 45
16 Apr 2015
2 Hefte pro Jahr

The assessment of students’ academic achievements helps to increase learning effectiveness by encouraging each student to recognise his/her strengths and areas for improvement. To do so, pedagogical activities that encourage direct and frequent evaluation must be considered. This paper focuses on how a learning management system such as Google Classroom (GC) together with learning analytics (LA) can be used to extract and analyse learner’s data from Science, Technology, Engineering, Art and Mathematics (STEAM) course. In addition, we explore how to employ these data to support metacognitive skills such as self-regulated learning (SRL). An explanatory sequential mixed-method design research was used, and two research questions were set, discussed and analysed. Data collection involved 128 participants. Our findings confirmed the potential of using achievement-based grading rubrics data and LA tools to provide empirical evidence of how formative assessment can affect students’ SRL development. While onsite experience has revealed some important initial findings, further research is needed. To validate these results, it will be necessary to perform similar analyses on datasets obtained from other schools and subject areas. Despite the increasing interest in use of LA, there is a scarcity of research on this field for secondary school education.

Agudo-Peregrina, Á. F., Iglesias-Pradas, S., Conde-González, M. Á., & Hernández-García, Á. (2014). Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relationship with performance in VLE-supported F2F and online learning. Computers in human behavior, 31, 542-550.10.1016/j.chb.2013.05.031 Search in Google Scholar

Amale, G. (2021). L’impact d’une grille d’évaluation critériée et élaborée sur l’amélioration des compétences rédactionnelles en FLE au supérieur: Cas des étudiants de 1 ère année du département de français-Université Batna2-The impact of a Criteria-Based and Elaborated Evaluation Grid. Revue des Sciences Humaines, 21(02), 1168-1183. Search in Google Scholar

Arnold, K. E., & Pistilli, M. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd international conference on learning analytics and knowledge (pp. 267-270).10.1145/2330601.2330666 Search in Google Scholar

Bernard, R. M., Abrami, P. C., Borokhovski, E., Wade, C. A., Tamim, R. M., Surkes, M. A., & Bethel, E. C. (2009). A meta-analysis of three types of interaction treatments in distance education. Review of Educational research, 79(3), 1243-1289.10.3102/0034654309333844 Search in Google Scholar

Berthier, J. L., Borst, G., & Guilleray, F. (2021). Les neurosciences cognitives dans la classe: Guide pour expérimenter et adapter ses pratiques pédagogiques. ESF sciences humaines. Search in Google Scholar

Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: Beliefs, techniques, and illusions. Annual review of psychology, 64, 417-444.10.1146/annurev-psych-113011-143823 Search in Google Scholar

Blikstein, P. (2011). ‘Using learning analytics to assess students’ behavior in open-ended programming tasks’, paper Presented at the 1st International Conference on Learning Analytics and Knowledge (LAK11), Banff, Canada (27th February – 1st March).10.1145/2090116.2090132 Search in Google Scholar

Brookhart, S. M. (2013). How to create and use rubrics for formative assessment and grading. Ascd. Search in Google Scholar

Brown, P. C., Roediger, H. L., & McDaniel, M. A. (2016). Mets-toi ça dans la tête!: les stratégies d’apprentissage à la lumière des sciences cognitives (p. 1). Éditions Markus Haller. Search in Google Scholar

Bulletin officiel n°31 (2020). Relatif aux programmes d’enseignement : cycle des apprentissages fondamentaux (cycle 2), cycle de consolidation (cycle 3) et cycle des approfondissements (cycle 4) : modification. Arrêté du 17-7-2020 et J.O. du 28-7-2020. 30 July 2020, NOR : MENE2018714A (France). Search in Google Scholar

Bybee, R. W. (2013). The case for STEM education: Challenges and opportunities. NSTA press. Search in Google Scholar

Conde, M. Á., Rodríguez-Sedano, F. J., Fernández-Llamas, C., Gonçalves, J., Lima, J., & García-Peñalvo, F. J. (2021). Fostering STEAM through challenge-based learning, robotics, and physical devices: A systematic mapping literature review. Computer Applications in Engineering Education, 29(1), 46-65.10.1002/cae.22354 Search in Google Scholar

Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research. Sage publications. Search in Google Scholar

Creswell, J. W., & Miller, D. L. (2000). Determining validity in qualitative inquiry. Theory into practice, 39(3), 124-130. http://dx.doi.org/10.1207/s15430421tip3903_210.1207/s15430421tip3903_2 Search in Google Scholar

Creswell, J. W., & Poth, C. N. (2016). Qualitative inquiry and research design: Choosing among five approaches. Sage publications. Search in Google Scholar

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. psychometrika, 16(3), 297-334.10.1007/BF02310555 Search in Google Scholar

Dawson, S., Joksimovic, S., Poquet, O., & Siemens, G. (2019). Increasing the impact of learning analytics. In Proceedings of the 9th International Conference on Learning Analytics & Knowledge (pp. 446-455).10.1145/3303772.3303784 Search in Google Scholar

Deci, E. L., & Ryan, R. M. (2000). The” what” and” why” of goal pursuits: Human needs and the self-determination of behavior. Psychological inquiry, 11(4), 227-268.10.1207/S15327965PLI1104_01 Search in Google Scholar

Décret n° 2015-372 (2015). Relatif au socle commun de connaissances, de compétences et de culture. 31 Mars 2015, NOR: MENE1506516D (France). Search in Google Scholar

Dick, W., Carey, L., & Carey, J. O. (2005). The systematic design of instruction. Search in Google Scholar

Dunn, O. J. (1964) Multiple Comparisons Using Rank Sums, Technometrics, 6:3, 241-252, DOI: 10.1080/00401706.1964.1049018110.1080/00401706.1964.10490181 Search in Google Scholar

Ferguson, R. (2012). Learning analytics: drivers, developments, and challenges. International Journal of Technology Enhanced Learning, 4(5-6), 304-317.10.1504/IJTEL.2012.051816 Search in Google Scholar

Ferguson, R., Brasher, A., Clow, D., Cooper, A., Hillaire, G., Mittelmeier, J., Rienties, B., Ullmann, T. and Vuorikari, R. 2016. Research Evidence on the Use of Learning Analytics: Implications for Education Policy. (2016). Search in Google Scholar

Gagné, M. (2003). The role of autonomy support and autonomy orientation in prosocial behavior engagement. Motivation and emotion, 27(3), 199-223.10.1023/A:1025007614869 Search in Google Scholar

Gibbons, A. S., & Rogers, P. C. (2009). The architecture of instructional theory. Instructional-design theories and models, 3, 305-326. Search in Google Scholar

Gilovich, T. (2008). How we know what isn’t so. Simon and Schuster. Search in Google Scholar

Goff, W., & Veresov, N. (2015). Examining teacher-researcher collaboration through the cultural interface. Cultural Studies of Science Education, 10(3), 621-627. http://dx.doi.org/10.1007/s11422-015-9665-910.1007/s11422-015-9665-9 Search in Google Scholar

Gupta, A., & Pathania, P. (2021). To study the impact of Google Classroom as a platform of learning and collaboration at the teacher education level. Education and Information Technologies, 26(1), 843-857.10.1007/s10639-020-10294-1 Search in Google Scholar

Guskey, T. R., & Bailey, J. M. (2010). Developing standards-based report cards. Corwin Press. Search in Google Scholar

Harris, A., & de Bruin, L. R. (2018). Compulsory secondary school creativity, teacher practice and STEM education: An international study. Journal of Educational Change, 19(2), 153-179.10.1007/s10833-017-9311-2 Search in Google Scholar

Inspection Pédagogique Régionale. (2017). Guide Pratique de l’Evaluation (pp. http://www1.ac–poitiers.fr/medias/fichier/guide–pratique–evaluation–15–02–2017_1487230308978.pdf). Poitiers: Académie de Poitiers. Search in Google Scholar

Johnson, L., Smith, R., Willis, H., Levine, A. and Haywood, K. (2011) The Horizon Report: 2011 Edition, The New Media Consortium, Austin, Texas. Search in Google Scholar

Joksimović, S., Gašević, D., Loughin, T. M., Kovanović, V., & Hatala, M. (2015). Learning at distance: Effects of interaction traces on academic achievement. Computers & Education, 87, 204-217.10.1016/j.compedu.2015.07.002 Search in Google Scholar

Kopeyev, Z., Mubarakov, A., Kultan, J., Aimicheva, G. & Tuyakov, Y. (2020). Using a Personalized Learning Style and Google Classroom Technology to Bridge the Knowledge Gap on Computer Science. International Journal of Emerging Technologies in Learning (iJET), 15(2), 218-229. Kassel, Germany: International Journal of Emerging Technology in Learning. Retrieved 18th March 2021 from https://www.learntechlib.org/p/217171/. Search in Google Scholar

Kruskal, W. H., & Wallis, W. A. (1952). Use of ranks in one-criterion variance analysis. Journal of the American statistical Association, 47(260), 583-621.10.1080/01621459.1952.10483441 Search in Google Scholar

Levene, H. (1960). Contributions to probability and statistics. Essays in honor of Harold Hotelling, 278-292. Search in Google Scholar

Lilliefors, H. W. (1967). On the Kolmogorov-Smirnov test for normality with mean and variance unknown. Journal of the American statistical Association, 62(318), 399-402.10.1080/01621459.1967.10482916 Search in Google Scholar

Loi n° 2005-102 (2005). Pour l’égalité des droits et des chances, la participation et la citoyenneté des personnes handicapées. 11 Février 2005, NOR: SANX0300217L (France). Search in Google Scholar

Loi n° 2019-791 (2019). Pour une école de la confiance. 26 Juillet 2019, NOR: MENX1828765L (France). Search in Google Scholar

Martínez-Monés, A., Reffay, C., Torío, J. H., & Cristóbal, J. A. M. (2017, October). Learning Analytics with Google Classroom: Exploring the possibilities. In Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality (pp. 1-6).10.1145/3144826.3145397 Search in Google Scholar

Marzano, R. J., & Heflebower, T. (2011). Teaching & assessing 21st century skills. Solution Tree Press. Search in Google Scholar

Mazzola, L. and Mazza, R. (2011). ‘Visualizing learner models through data aggregation: a testcase’, paper presented at The Red-Conference, Rethinking Education in the Knowledge Society. Search in Google Scholar

Ministère de l’Éducation nationale, de la Jeunesse et des Sports - Direction générale de l’enseignement scolaire. (2016). Évaluer la maîtrise du socle commun aux cycles 2, 3 et 4. Retrieved March 18, 2021 from https://eduscol.education.fr/141/modalites–d–evaluation–des–acquis–scolaires–des–eleves. Search in Google Scholar

Moss, C. M., & Brookhart, S. M. (2012). Learning targets: Helping students aim for understanding in today’s lesson. ASCD. Search in Google Scholar

Muñoz, M. A., & Guskey, T. R. (2015). Standards-based grading and reporting will improve education. Phi Delta Kappan, 96(7), 64-68.10.1177/0031721715579043 Search in Google Scholar

Nemoto, T., & Beglar, D. (2014). Likert-scale questionnaires. In JALT 2013 conference proceedings (pp. 1-8). Search in Google Scholar

Ochoa, X., Suthers, D., Verbert, K., & Duval, E. (2014). Analysis and reflections on the third Learning Analytics and Knowledge Conference (LAK 2013). Journal of Learning Analytics, 1(2), 5-22.10.18608/jla.2014.12.2 Search in Google Scholar

O’Connor, K. (2009). Reforming grading practices in secondary schools. Principal’s Research Review, 4(1), 1-7. Search in Google Scholar

Oviedo, H. C., & Arias, A. C. (2005). Aproximación al uso del coeficiente alfa de Cronbach. Revista colombiana de psiquiatría, 34(4), 572-580. Search in Google Scholar

Proulx, C., Spencer-May, K., & Westerberg, T. (2012). Moving to Standards-Based Grading: Lessons from Omaha. Principal Leadership, 13(4), 30-34. Search in Google Scholar

Real Decreto 102/2010 (2010). Por el que se regula la ordenación de las enseñanzas acogidas al acuerdo entre el Gobierno de España y el Gobierno de Francia relativo a la doble titulación de Bachiller y de Baccalauréat en centros docentes españoles BOE-A-2010-4130 (Spain). Search in Google Scholar

Rodríguez-Triana, M. J., Martínez-Monés, A., Asensio-Pérez, J. I., & Dimitriadis, Y. (2015). Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations. British Journal of Educational Technology, 46(2), 330-343.10.1111/bjet.12198 Search in Google Scholar

Schellings G, Van Hout-Wolters B (2011). Measuring strategy use with self-report instruments: theoretical and empirical considerations. Metacogn Learn 6, 83–90.10.1007/s11409-011-9081-9 Search in Google Scholar

Scriffiny, P. L. (2008). Standards-based grading. Educational Leadership. Search in Google Scholar

Sebesta, A. J., & Bray Speth, E. (2017). How should I study for the exam? Self-regulated learning strategies and achievement in introductory biology. CBE—Life Sciences Education, 16(2), ar30.10.1187/cbe.16-09-0269 Search in Google Scholar

Slade, S., & Prinsloo, P. (2014). Student perspectives on the use of their data: Between intrusion, surveillance, and care. In Challenges for Research into Open & Distance Learning: Doing Things Better – Doing Better Things (pp. 291—300). Oxford, UK: European Distance and E-Learning Network Search in Google Scholar

Soriano Rodríguez, A. M. (2015). Diseño y validación de instrumentos de medición.10.5377/dialogos.v0i14.2202 Search in Google Scholar

Stanton JD, Neider XN, Gallegos IJ, Clark NC (2015). Differences in metacognitive regulation in introductory biology students: when prompts are not enough. CBE Life Sci Educ 14, ar15.10.1187/cbe.14-08-0135 Search in Google Scholar

Stiggins, R., & Chappuis, J. (2008). Enhancing student learning. District Administration, 44(1), 42-44. Search in Google Scholar

Tanner KD (2012). Promoting student metacognition. CBE Life Sci Educ 11, 113–120. Dinsmore DL, Alexander PA,10.1187/cbe.12-03-0033 Search in Google Scholar

Tinto, V. (2005). College student retention: Formula for student success. Greenwood Publishing Group. Search in Google Scholar

Tomlinson, C. A., & McTighe, J. (2006). Integrating differentiated instruction & understanding by design: Connecting content and kids. ASCD. Search in Google Scholar

Vallance, M., & Towndrow, P. A. (2016). Pedagogic transformation, student-directed design, and computational thinking. Pedagogies: an international journal, 11(3), 218-234.10.1080/1554480X.2016.1182437 Search in Google Scholar

Veenman MVJ (2011). Alternative assessment of strategy use with self-report instruments: a discussion. Metacogn Learn 6, 205–211.10.1007/s11409-011-9080-x Search in Google Scholar

Vescio, V., Ross, D., & Adams, A. (2008). A review of research on the impact of professional learning communities on teaching practice and student learning. Teaching and teacher education, 24(1), 80-91.10.1016/j.tate.2007.01.004 Search in Google Scholar

Wang, M. T., Ye, F., & Degol, J. L. (2017). Who chooses STEM careers? Using a relative cognitive strength and interest model to predict careers in science, technology, engineering, and mathematics. Journal of youth and adolescence, 46(8), 1805-1820.10.1007/s10964-016-0618-8 Search in Google Scholar

Wise, A. F., Zhao, Y., & Hausknecht, S. N. (2013). Learning analytics for online discussions: a pedagogical model for intervention with embedded and extracted analytics. In Proceedings of the third international conference on learning analytics and knowledge (pp. 48-56).10.1145/2460296.2460308 Search in Google Scholar

Zimmerman BJ, Martinez-Pons M (1986). Development of a structured interview for assessing student use of self-regulated learning strategies. Am Educ Res J 23, 614–628.10.3102/00028312023004614 Search in Google Scholar

Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and prospects. American Educational Research Journal, 45(1), 166–183. https://doi.org/10.3102/0002831207312909.10.3102/0002831207312909 Search in Google Scholar

Empfohlene Artikel von Trend MD

Planen Sie Ihre Fernkonferenz mit Scienceendo