How to Choose an Appropriate Reviewer Assignment Strategy in Peer Assessment System? Considering Fairness and Incentive

DOI

10.2991/icmesd-18.2018.107How to use a DOI?

Keywords

Peer Assessment, Reviewer Assignment, EduPCR, Fairness, Incentive

Abstract

As a prior process of peer assessment, reviewer assignment plays a critical role and, eventually, determines the performance of peer assessment. Nowadays, so many reviewer assignment strategies exist that relevant researchers need a big picture of reviewer assignment strategies. In this study, we propose a taxonomy of reviewer assignment strategies, which consists of four dimensions including stability, anonymity, number ratio (reviewer to author), and assigner. We analyze the fairness and incentive effect of each reviewer assignment strategy. Then we share our experiences and lessons from implementation of an online peer assessment system in educational context, which could be references for relevant scholars and instructors.

Copyright

© 2018, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Yan-Qing Wang
AU  - Fu-Quan Sun
PY  - 2018/05
DA  - 2018/05
TI  - How to Choose an Appropriate Reviewer Assignment Strategy in Peer Assessment System? Considering Fairness and Incentive
BT  - Proceedings of the 4th Annual International Conference on Management, Economics and Social Development (ICMESD 2018)
PB  - Atlantis Press
SP  - 603
EP  - 608
SN  - 2352-5428
UR  - https://doi.org/10.2991/icmesd-18.2018.107
DO  - 10.2991/icmesd-18.2018.107
ID  - Wang2018/05
ER  -