Automatic grading of answers in knowledge control for “Definition” and “Description” question types
Učënye zapiski Kazanskogo universiteta. Seriâ Fiziko-matematičeskie nauki, Uchenye Zapiski Kazanskogo Universiteta. Seriya Fiziko-Matematicheskie Nauki, Tome 166 (2024) no. 4, pp. 580-593
Voir la notice du chapitre de livre provenant de la source Math-Net.Ru
The progress in developing an effective automatic knowledge control system is directly associated with creating and implementing a software module for grading answers to test questions formulated in natural language. Previously, an experimental prototype of such a system was designed, and a study was performed where short answers to basic question types provided by students were examined via a pragmatically oriented question-answer text processing algorithm, considering its outputs and exposing flaws. This article introduces the next iteration of the algorithm tailored to handle more complex question types that requires the identification of relations such as “Definition” and “Description.” The key features of the enhanced algorithm were outlined, with a particular focus on the problem of segmenting answers into meaningful chunks, a task for which processing methods have already been found. The results of an experiment based on the developed prototype with obtaining answers from students and a thorough analysis of the instances of the system’s incorrect behavior were discussed.
Keywords:
natural language processing, automatic answer grading, e-learning.
@article{UZKU_2024_166_4_a8,
author = {N. A. Prokopyev},
title = {Automatic grading of answers in knowledge control for {{\textquotedblleft}Definition{\textquotedblright}} and {{\textquotedblleft}Description{\textquotedblright}} question types},
journal = {U\v{c}\"enye zapiski Kazanskogo universiteta. Seri\^a Fiziko-matemati\v{c}eskie nauki},
pages = {580--593},
publisher = {mathdoc},
volume = {166},
number = {4},
year = {2024},
language = {ru},
url = {http://geodesic.mathdoc.fr/item/UZKU_2024_166_4_a8/}
}
TY - JOUR AU - N. A. Prokopyev TI - Automatic grading of answers in knowledge control for “Definition” and “Description” question types JO - Učënye zapiski Kazanskogo universiteta. Seriâ Fiziko-matematičeskie nauki PY - 2024 SP - 580 EP - 593 VL - 166 IS - 4 PB - mathdoc UR - http://geodesic.mathdoc.fr/item/UZKU_2024_166_4_a8/ LA - ru ID - UZKU_2024_166_4_a8 ER -
%0 Journal Article %A N. A. Prokopyev %T Automatic grading of answers in knowledge control for “Definition” and “Description” question types %J Učënye zapiski Kazanskogo universiteta. Seriâ Fiziko-matematičeskie nauki %D 2024 %P 580-593 %V 166 %N 4 %I mathdoc %U http://geodesic.mathdoc.fr/item/UZKU_2024_166_4_a8/ %G ru %F UZKU_2024_166_4_a8
N. A. Prokopyev. Automatic grading of answers in knowledge control for “Definition” and “Description” question types. Učënye zapiski Kazanskogo universiteta. Seriâ Fiziko-matematičeskie nauki, Uchenye Zapiski Kazanskogo Universiteta. Seriya Fiziko-Matematicheskie Nauki, Tome 166 (2024) no. 4, pp. 580-593. http://geodesic.mathdoc.fr/item/UZKU_2024_166_4_a8/