Applicability and Efficiency of a Polytomous IRT-Based Computerized Adaptive Test for Measuring Psychological Traits

Authors : Ahmet Salih ŞİMŞEK, Ezel TAVŞANCIL

Pages : 328-344

Doi:10.21031/epod.1148313

View : 24 | Download : 17

Publication Date : 2022-12-25

Article Type : Research Paper

Abstract :Currently, research on computerized adaptive testing insert ignore into journalissuearticles values(CAT); focuses mainly on dichotomous items and cognitive traits insert ignore into journalissuearticles values(achievement, aptitude, etc.);. However, polytomous IRT-based CAT is a promising research area for measuring psychological traits that has attracted much attention. The main purpose of this study is to test the practicality of the polytomous IRT-based CAT and its equivalence with the paper-pencil version. Data were collected from 1449 high school students insert ignore into journalissuearticles values(45% female); via the paper-pencil version. The data were used for IRT parameter estimates and CAT simulation studies. For the equivalence study, the research group consisted of 81 students insert ignore into journalissuearticles values(47% female); who participated in both the paper-pencil and live CAT applications. The paper-pencil version of the vocational interest inventory consists of 17 factors and 164 items. When the EAP estimation method and setting SE < .50 as the termination criterion, better performance was obtained compared with other CAT designs. The Item selection did not help to reduce test duration or increase measurement accuracy. As a result, it was found that an area of interest can be assessed with four items. The results of the live CAT application showed that the estimates of CAT were strongly positively correlated with its paper-pencil version. In addition, the live CAT application increased applicability compared to the fixed-length test version by reducing test length by 50% and time by 77%. This study shows that the polytomous IRT-based CAT is applicable and efficient for measuring psychological traits.
Keywords : polytomous item response model, computerized adaptive test, equivalence, efficiency, measurement precision