The study of the effect of item parameter drift on ability estimation obtained from adaptive testing under different conditions

Authors : Merve ŞAHİN KÜRŞAD, Ömay ÇOKLUK-BÖKEOGLU, Nükhet ÇIKRIKÇI

Pages : 654-681

Doi:10.21449/ijate.1070848

View : 18 | Download : 4

Publication Date : 2022-09-30

Article Type : Research Paper

Abstract :Item parameter drift insert ignore into journalissuearticles values(IPD); is the systematic differentiation of parameter values of items over time due to various reasons. If it occurs in computer adaptive tests insert ignore into journalissuearticles values(CAT);, it causes errors in the estimation of item and ability parameters. Identification of the underlying conditions of this situation in CAT is important for estimating item and ability parameters with minimum error. This study examines the measurement precision of IPD and its impacts on the test information function insert ignore into journalissuearticles values(TIF); in CAT administrations. This simulation study compares sample size insert ignore into journalissuearticles values(1000, 5000);, IPD size insert ignore into journalissuearticles values(0.00 logit, 0.50 logit, 0.75 logit, 1.00 logit);, percentage of items containing IPD insert ignore into journalissuearticles values(0%, 5%, 10%, 20%);, three time points and item bank size insert ignore into journalissuearticles values(200, 500, 1000); conditions. To examine the impacts of the conditions on ability estimations; measurement precision, and TIF values were calculated, and factorial analysis of variance insert ignore into journalissuearticles values(ANOVA); for independent samples was carried out to examine whether there were any differences between estimations in terms of these factors. The study found that an increase in the number of measurements using item bank with IPD items results in a decrease in measurement precision and the amount of information the test provides. Factorial ANOVA for independent samples revealed that measurements precision and TIF differences are mostly statistically significant. Although all IPD conditions negatively affect measurement precision and TIF, it has been shown that sample size and item bank size generally do not have an increasing or decreasing effect on these factors.
Keywords : Item parameter drift, Computer adaptive test, Measurement precision, Test information function