Proceedings of the 2023 4th International Conference on Education, Knowledge and Information Management (ICEKIM 2023)

90Validation of School-Based College English Listening Test: Evaluating Construct Validity Using the 3PL Item Response Theory Model

Authors
Meng Lyu1, *
1Xi’an Jiaotong University, Xi’an, China
*Corresponding author. Email: mariannelyu@stu.xjtu.edu.cn
Corresponding Author
Meng Lyu
Available Online 30 June 2023.
DOI
10.2991/978-94-6463-172-2_228How to use a DOI?
Keywords
Item Response Theory; Construct validity; Listening test
Abstract

More and more universities are implementing school-based English exams designed and administered by their professors, yet there is limited research on the quality and reliability of school-based exams. This study aims to evaluate the validity of the school-based college English listening test items according to the three-parameter logistic model in the Item Response Theory (IRT). The test consisted of 25 items, and 944 male and female college students from a university in Western China were selected in a simple random manner in this study. The statistical program (SPSS) and the (Bilog-mg3) program were used to analyze the responses of these participants. In this research, the validity of the school-based college English listening test was assessed on two levels: whether the items conformed to the questioning norms and whether they effectively represented the construct validity. The results showed that this set of listening items were high in difficulty, ideal in differentiation, high in guessing, reasonable in information content, and with a certain degree of constructive validity, which could accurately reflect the actual listening proficiency of the intermediate and high-level test takers.

Copyright
© 2023 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

Volume Title
Proceedings of the 2023 4th International Conference on Education, Knowledge and Information Management (ICEKIM 2023)
Series
Atlantis Highlights in Computer Sciences
Publication Date
30 June 2023
ISBN
10.2991/978-94-6463-172-2_228
ISSN
2589-4900
DOI
10.2991/978-94-6463-172-2_228How to use a DOI?
Copyright
© 2023 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Cite this article

TY  - CONF
AU  - Meng Lyu
PY  - 2023
DA  - 2023/06/30
TI  - 90Validation of School-Based College English Listening Test: Evaluating Construct Validity Using the 3PL Item Response Theory Model
BT  - Proceedings of the 2023 4th International Conference on Education, Knowledge and Information Management (ICEKIM 2023)
PB  - Atlantis Press
SP  - 2043
EP  - 2054
SN  - 2589-4900
UR  - https://doi.org/10.2991/978-94-6463-172-2_228
DO  - 10.2991/978-94-6463-172-2_228
ID  - Lyu2023
ER  -