Year 2019, Volume 6, Issue 1, Pages 155 - 168 2019-06-17

Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis

Mahmut Sami Koyuncu [1] , Ayşenur Erdemir [2]

0 38

The aim of the study is to compare TIMSS 2011 proficiency levels with the proficiency levels defined by the researchers using cluster analysis for Turkey, Korean, Norway, and Morocco in 4th and 8th grades in the fields of science and mathematics. Therefore, it is tried to be reached that these cut-off scores for each country can serve the evaluation of each country itself. For this research, the data gathered from related countries’ students was taken from TIMSS 2011 database. Statistical analysis was performed with SPSS Version 21.0 statistic software package. The cut-off scores for these four countries selected in this study for each grade level and course type were defined using cluster analysis. Then, proficiency levels according to these cut-off scores were compared to the general TIMSS 2011 proficiency levels, and so the difference between these levels and percentage of agreement have been examined. According to the results, cut-off scores set by using cluster analysis for Korea were higher than TIMSS international benchmarks. Cut-off scores set for Morocco, Norway, and Turkey were lower than TIMSS international benchmarks. the percentage of agreement of the proficiency levels was found to be between 8.1% and 70.0%, and in general, it has been found that the percentage of agreement was low. Consequently, it is suggested that countries should make a standard-setting study for their own samples instead of using TIMSS international benchmarks for their own evaluations.

Standard Setting, Cluster Analysis, Validity, TIMSS2011
  • Berberoğlu, G. (2009). Madde Haritalama Yöntemi ve Cito Türkiye Öğrenci İzleme Sistemi (ÖİS) Uygulamalarında Yeterlik Düzeylerinin Belirlenmesi. Cito Eğitim: Kuram ve Uygulama Dergisi, Mayıs-Haziran 2009, 13-24.
  • Cizek, G. (2001). Conjectures on the rise and call of standard-setting: An introduction to context and practice. In G. J. Cizek (Ed.), Setting performance standards: Concepts,methods, and perspectives (pp. 3–17). Mahwah, NJ: Erlbaum.
  • Crocker, L. ve Algina, J. (1986). Intruduction to Classical and Modern Test Theory. New York: CBS.
  • Dinçer, E. (2006). Veri Madenciliğinde K-MEANS Algoritması ve Tıp Alanında Uygulanması. Kocaeli Üniversitesi, Fen Bilimleri Enstitüsü, Yüksek Lisans Tezi.
  • Gündeğer, C., Doğan, N. (2014). Standart Belirlemede İstatistiksel Bir Yaklaşım: Kümeleme Analizi, IV. Ulusal Eğitimde Ve Psikolojide Ölçme ve Değerlendirme Kongresi (Sözlü Bildiri), 9-13 Haziran 2014, Ankara Hacettepe.
  • Hess, B., Subhiyah, R. G., & Giordano, C. (2007). “Convergence Between Cluster Analysis and the Angoff Method for Setting Minimum Passing Scores on Credentialing Examinations”. Evaluation and the Health Professions, 30 (4), 362-375.
  • Mullis, I. V., Martin, M. O., Foy, P., & Arora, A. (2012). TIMSS 2011 international results in mathematics. International Association for the Evaluation of Educational Achievement. Herengracht 487, Amsterdam, 1017 BT, The Netherlands.
  • Sireci, S. G., Robin, F., & Patelis, T. (1999). Using cluster analysis to facilitate standard setting. Applied Measurement in Education, 12(3), 301-325.
  • Violato, C., Marini, A., & Lee, C. (2003). A validity study of expert judgment procedures for setting cutoff scores on high-stakes credentialing examinations using cluster analysis. Evaluation & the health professions, 26(1), 59-72.
Primary Language en
Subjects Social
Journal Section Articles
Authors

Orcid: 0000-0002-6651-4851
Author: Mahmut Sami Koyuncu (Primary Author)
Institution: GAZI UNIVERSITY, GAZİ FACULTY OF EDUCATION
Country: Turkey


Orcid: 0000-0001-9656-0878
Author: Ayşenur Erdemir
Institution: GAZI UNIVERSITY, GAZİ FACULTY OF EDUCATION
Country: Turkey


Dates

Publication Date: June 17, 2019

Bibtex @research article { ijcer544194, journal = {International Journal of Contemporary Educational Research}, issn = {}, eissn = {2148-3868}, address = {Mustafa AYDIN}, year = {2019}, volume = {6}, pages = {155 - 168}, doi = {10.33200/ijcer.544194}, title = {Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis}, key = {cite}, author = {Koyuncu, Mahmut Sami and Erdemir, Ayşenur} }
APA Koyuncu, M , Erdemir, A . (2019). Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis. International Journal of Contemporary Educational Research, 6 (1), 155-168. DOI: 10.33200/ijcer.544194
MLA Koyuncu, M , Erdemir, A . "Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis". International Journal of Contemporary Educational Research 6 (2019): 155-168 <http://ijcer.net/issue/45744/544194>
Chicago Koyuncu, M , Erdemir, A . "Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis". International Journal of Contemporary Educational Research 6 (2019): 155-168
RIS TY - JOUR T1 - Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis AU - Mahmut Sami Koyuncu , Ayşenur Erdemir Y1 - 2019 PY - 2019 N1 - doi: 10.33200/ijcer.544194 DO - 10.33200/ijcer.544194 T2 - International Journal of Contemporary Educational Research JF - Journal JO - JOR SP - 155 EP - 168 VL - 6 IS - 1 SN - -2148-3868 M3 - doi: 10.33200/ijcer.544194 UR - https://doi.org/10.33200/ijcer.544194 Y2 - 2019 ER -
EndNote %0 International Journal of Contemporary Educational Research Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis %A Mahmut Sami Koyuncu , Ayşenur Erdemir %T Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis %D 2019 %J International Journal of Contemporary Educational Research %P -2148-3868 %V 6 %N 1 %R doi: 10.33200/ijcer.544194 %U 10.33200/ijcer.544194
ISNAD Koyuncu, Mahmut Sami , Erdemir, Ayşenur . "Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis". International Journal of Contemporary Educational Research 6 / 1 (June 2019): 155-168. https://doi.org/10.33200/ijcer.544194
AMA Koyuncu M , Erdemir A . Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis. International Journal of Contemporary Educational Research. 2019; 6(1): 155-168.
Vancouver Koyuncu M , Erdemir A . Comparison of International TIMSS 2011 Proficiency Levels and Cut-off Scores Set by Using Cluster Analysis. International Journal of Contemporary Educational Research. 2019; 6(1): 168-155.