Exploring the Efficacy of GenAI in Grading SQL Query Tasks: A Case Study
Data publikacji: 19 wrz 2024
Zakres stron: 102 - 111
Otrzymano: 07 sie 2024
Przyjęty: 21 sie 2024
DOI: https://doi.org/10.2478/cait-2024-0027
Słowa kluczowe
© 2024 Thair Hamtini et al., published by Sciendo
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Numerous techniques, including problem-solving, seeking clarification, and creating questions, have been employed to utilize generative Artificial Intelligence (AI) in education. This study investigates the possibility of using Generate AI (GenAI) to grade Structured Query Language (SQL) queries automatically. Three models were used which are ChatGPT, Gemini, and Copilot. The study uses an experimental approach to assess how well the models perform in evaluating student responses by comparing the models’ accuracy with those of human experts. The results showed that despite some inconsistencies, GenAI holds great promise for streamlining. Thus, further research is required in light of inconsistent GenAI performance. If these issues were resolved, GenAI can be utilized in education. However, human oversight and ethical issues must always come first.