Proceedings of the Pacific-Rim Objective Measurement Symposium (PROMS 2023)

<Previous Article In Volume
Next Article In Volume>

Measuring Scientific Creativity with Subjective Creativity Assessments: Psychometric Challenges and Suggestions

Authors
Sujie Yang1, Jue Wang1, *
1University of Science and Technology of China, Hefei, Anhui, 230026, P.R. China
*Corresponding author. Email: juewang01@ustc.edu.cn
Corresponding Author
Jue Wang
Available Online 22 August 2024.
DOI
10.2991/978-94-6463-494-5_4How to use a DOI?
Keywords
psychometric theory; scientific creativity; subjective creativity assessment; Rasch measurement theory; unfolding theory
Abstract

The research on scientific creativity plays an increasingly important role in education. Scientific creativity can be viewed as a type of domain-specific creativity. Subjective creativity assessments (SCA) are particularly useful for measuring domain-specific creativity and earned wide popularity in evaluating product-based creativity. However, under the psychometric framework of examining rating scores, the application of SCA has several challenges, including (a) a lack of clarity and consistency among raters on the understanding and rating criteria of scientific creativity, (b) varying levels of reliability and validity across studies, and (c) insufficient evidence for supporting fairness and comparability arguments. In this study, we address several issues related to raters and rating scores with the use of SCA, and provide a psychometric framework for evaluating the quality of ratings and assessment design of SCA. Suggestions for psychometric analysis for creating objective and fair measurement of scientific creativity are discussed.

Copyright
© 2024 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

<Previous Article In Volume
Next Article In Volume>
Volume Title
Proceedings of the Pacific-Rim Objective Measurement Symposium (PROMS 2023)
Series
Atlantis Highlights in Social Sciences, Education and Humanities
Publication Date
22 August 2024
ISBN
978-94-6463-494-5
ISSN
2667-128X
DOI
10.2991/978-94-6463-494-5_4How to use a DOI?
Copyright
© 2024 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Cite this article

risenwbib
TY  - CONF
AU  - Sujie Yang
AU  - Jue Wang
PY  - 2024
DA  - 2024/08/22
TI  - Measuring Scientific Creativity with Subjective Creativity Assessments: Psychometric Challenges and Suggestions
BT  - Proceedings of the Pacific-Rim Objective Measurement Symposium (PROMS 2023)
PB  - Atlantis Press
SP  - 65
EP  - 81
SN  - 2667-128X
UR  - https://doi.org/10.2991/978-94-6463-494-5_4
DO  - 10.2991/978-94-6463-494-5_4
ID  - Yang2024
ER  -