Natural Language Processing Research

Volume 1, Issue 3-4, March 2021, Pages 46 - 55

Web-Based Turkish Automatic Short-Answer Grading System

Authors
Ebru Yilmaz Ince1, *, ORCID, Akif Kutlu2
1Isparta University of Applied Sciences, Isparta, Turkey
2Süleyman Demirel University, Isparta, Turkey
*Corresponding author. Email: ebruince@isparta.edu.tr
Corresponding Author
Ebru Yilmaz Ince
Received 1 December 2020, Accepted 10 January 2021, Available Online 22 February 2021.
DOI
10.2991/nlpr.d.210212.001How to use a DOI?
Keywords
Engineering education; Educational technologies; Automatic short answer grading; Latent semantic analysis; Natural language processing
Abstract

In this paper, a web-based Turkish automatic short answer grading system (TASAG) is developed to score exam questions and to generate online exams for automatic scoring of short-answer questions. The novelty of this study is that TASAG is the first software of its kind for the Turkish language. The algorithm of the TASAG software is a hybrid that determines which method will be used at runtime based on the word number dimensions to achieve accurate scoring. To measure the software's accuracy, a case study is performed for computer engineering. Instructors' scoring results and the TASAG software scoring results were compared. Two instructors prepared different answer keys for the same exam to increase the accuracy of the scoring. The scoring results, which are compared in the figures, are very close to each other, which indicate the effectiveness of the TASAG software. Moreover, the TASAG arithmetic mean scores for each answer key are calculated and given as the final score for the exam. According to the results, the TASAG software can be used for automated short answer grading system in Turkish with a 92% success rate.

Copyright
© 2021 The Authors. Published by Atlantis Press B.V.
Open Access
This is an open access article under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)
View full text (HTML)

Journal
Natural Language Processing Research
Volume-Issue
1 - 3-4
Pages
46 - 55
Publication Date
2021/02/22
ISSN (Online)
2666-0512
DOI
10.2991/nlpr.d.210212.001How to use a DOI?
Copyright
© 2021 The Authors. Published by Atlantis Press B.V.
Open Access
This is an open access article under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

TY  - JOUR
AU  - Ebru Yilmaz Ince
AU  - Akif Kutlu
PY  - 2021
DA  - 2021/02/22
TI  - Web-Based Turkish Automatic Short-Answer Grading System
JO  - Natural Language Processing Research
SP  - 46
EP  - 55
VL  - 1
IS  - 3-4
SN  - 2666-0512
UR  - https://doi.org/10.2991/nlpr.d.210212.001
DO  - 10.2991/nlpr.d.210212.001
ID  - Ince2021
ER  -