DoctorateOpen Access

Comparison of test equating methods based on Classical Test Theory and Item Response Theory: International Student Assessment Program (PISA) 2012 mathematics test case

2021
0 views
0 downloads
Advisor: Prof. Dr. Mehtap Çakan

Abstract (EN)

In this study, it was aimed to determine the most appropriate equating method with the least equating error by using the equating methods in Classical Test Theory and Item Response Theory. The scores of the booklet 1 and the booklet 3 in the PISA 2012 Mathematics test were used to be equated for the data of the research. The data of Turkey, Indonesia, Shanghai / China and Finland were selected for the research. In the study, Tucker (w1 = 1, w1 = 0.5), Levine observed score (w1 = 1, w1 = 0.5), Levine true score, classical congeneric and Braun-Holland methods were used. Among these methods, Tucker equalization was found to equate with the fewer error, and Levine true score equating method equated with the highest error. The smoothing procedure was completed before the equipercentile equating methods in the Classical Test Theory. The C 6 polynomial degree and beta4 binomial function in the pre-smoothing, and the cubic spline S 0,05 degree for the final smoothing were selected as the most appropriate smoothing at the end of the analytical and graphical process. When compared to each other according to their distribution within the error band value and the amount of error, it was found that the beta4 binomial function was the best smoothing method, while the C 6 polynomial degree had the highest error. Frequency estimation (w1 = 1, w1 = 0.5) equating method were used in the equipercentile equating process. For equipercentile equating, the least error was obtained from the w1=0,5 frequency estimation method, and the highest error was obtained from the w1=1 frequency estimation equipercentile equating method. When the linear and equipercentile equating. Methods related to Classical Test Theory were compared, it was seen that scores equated with less errors were obtained in equipercentile equating. The equating process based on Item Response Theory started with making calibration. It was seen that the Stocking-Lord method provided better results among item characteristic curve calibration methods. When the equated scores obtained from the Item Response Theory observed and real point equating methods were compared, it was concluded that the Item Response Theory actual score equating contained less errors. When the equating methods in the theories were compared, it was found that the Item Response Theory methods made equalization with less error. It is recommended to make equating based on Item Response Theory true score in equating studies.

Author

Dr. Ceren Mutluer

Institution

How to Cite

Ceren Mutluer (Doctorate thesis). Comparison of test equating methods based on Classical Test Theory and Item Response Theory: International Student Assessment Program (PISA) 2012 mathematics test case, 2021, Gazi University.

License

Tüm Hakları Saklıdır

This work is shared under the specified license terms.

More theses from Gazi University