A New Method for Setting Response-Time Threshold to Detect Test Takers’ Rapid Guessing Behavior

DOI

10.2991/assehr.k.210423.062How to use a DOI?

Keywords

threshold, response time, rapid guessing, effectiveness

Abstract

Anomalous behaviour such as rapid guessing in item response can affect test validity and the utility of decisions made with test scores, making it critical to identify this anomalous behaviour. The author proposes a new nonparametric method for setting a response-time threshold for flagging rapid guessing behaviour of item responses. Using data from the computer base national exam of Junior High School in Indonesia, the author analysis and compares the effectiveness of the new and existing method for detecting rapid guessing behaviour based on response time. Based on ROC curve analysis, the author concludes a new method for setting a response-time threshold is more effective than existing methods.

Copyright

© 2021, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Deni Hadiana
AU  - Bahrul Hayat
AU  - Burhanuddin Tola
PY  - 2021
DA  - 2021/04/26
TI  - A New Method for Setting Response-Time Threshold to Detect Test Takers’ Rapid Guessing Behavior
BT  - Proceedings of the International Conference on Educational Assessment and Policy (ICEAP 2020)
PB  - Atlantis Press
SP  - 46
EP  - 50
SN  - 2352-5398
UR  - https://doi.org/10.2991/assehr.k.210423.062
DO  - 10.2991/assehr.k.210423.062
ID  - Hadiana2021
ER  -