Measurement invairance and construct validity of the Turkish version of the learner autonomy scale in a sample of high and secondary school students
Abstract views: 319
/ 
PDF downloads: 224
DOI:
https://doi.org/10.52380/ijcer.2024.11.1.477Keywords:
Autonomy, Learner autonomy, Measurement invariance, Scale adaptationAbstract
The goal of this research is to adapt the 24-item "Learner Autonomy Scale" developed by Sereti and Giossos (2018) in higher education samples into Turkish by examining the psychometric properties of high school and secondary school samples, and to determine whether these groups are equivalent in terms of measurement invariance. The scale was applied in high school (n = 475) and secondary school (n = 395) samples consisting of 870 students. Different from the original four-factor scale form, EFA applied to both groups revealed a two-factor (factor load range: .308-.775) and 21-item. Correlation values (r = .209-.392, p˂.001) indicate that the factors are not strongly related. The factors produced adequate internal consistency coefficients (α = .706-.866; ω = .708-.871) and were validated by meeting the fit indices accepted in the literature for CFA. Measurement invariance tests revealed strong invariance for the structural and metric tests and partial invariance for the scalar test in high school and secondary school samples. More research is needed to determine why the intersections of items 19, 20, and 21 are not invariant. The main contribution to "learner autonomy" in this study is the adaptation and justification of a valid and reliable measurement tool for determining autonomy in the adolescent age group. The use of the adapted scale in different educational environments and in the examination of "autonomy" by adapting it specific to the field (science, mathematics, etc.) will provide important implications for further theoretical studies.
References
Aminah, M., Maulida, I. ve Supriadi, T. F. (2023). Project based learning in promoting learner autonomy. Open Journal Systems, 17(7), 1511-1516.
Ahmadianzadeh, B., Seifoori, Z. ve Tamjid, H. H. (2020). Exploring EFL teachers’ beliefs about and practices of learner autonomy across experience and licensure. Innovation in Language Learning and Teaching, 14(1), 1-7. DOI: https://doi.org/10.1080/17501229.2018.1501694
Asparouhov, T., & Muthén, B. (2014). Auxiliary variables in mixture modeling: Three-step approaches using M plus . Structural Equation Modeling, 21(3), 329–341. DOI: https://doi.org/10.1080/10705511.2014.915181
Anderson, T., & Dron, J. (2011). Three Generations of Distance Education Pedology. International Review of Research in Distance Learning, 12(3), 80-97. DOI: https://doi.org/10.19173/irrodl.v12i3.890
Bei, E., Mavroidis, I. ve Giossos, Y. (2019). Development of a scale for measurıng the learner autonomy of dıstance educatıon students. European Journal of Open, Distance and e-Learning, 22(2), 133-144. DOI: https://doi.org/10.2478/eurodl-2019-0015
Bei, E. (2016). Developing a range of autonomy for students in the HOU. Unpublished Postgraduate Thesis. Patras: HOU.
Benson, P. (2001). Teaching and Researching Autonomy in Language Learning. Harlow: Longman.
Bekker, M.H.J., & Van Assen, M.A.L.M. (2006). A Short Form of the Autonomy Scale: Properties of the Autonomy – Connectedness Scale (ACS-30). Journal of personality assessment, 86(1), 51-60. DOI: https://doi.org/10.1207/s15327752jpa8601_07
Basri F. (2023). Factors influencing learner autonomy and autonomy support in a faculty of education. Teaching in Higher Education, 28(2), 270-285.
Borg, S. ve Al-Busaidi, S. (2012). Teachers’ beliefs and practices regarding learner autonomy. ELT Journal, 66(3), 283-292. DOI: https://doi.org/10.1093/elt/ccr065
Baharom, N., & Shaari, A.H. (2022). Portfolio based assessment and learner autonomy practice among ESL students. Journal of Language and Linguistic Studies, 18(Special Issue 2), 1289-1305.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. The Guilford Press.
Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications and programming. New York: Routledge.
Burcu Şener & Enisa Mede (2023) Promoting learner autonomy and improving reflective thinking skills through reflective practice and collaborative learning, Innovation in Language Learning and Teaching, 17(2), 364-379.
Bryde, J. F., and Milburn, C. M. (1990). Helping to make the transition from school to college. In R. L. Emans (Ed.) Understanding undergraduate education (pp. 203-213). Vermillion, SD: University of South Dakota Press.
Chene, A. (1983). The concept of autonomy in adult education: a philosophical discussion. Adult Education Quarterly, 34(1), 38-47. DOI: https://doi.org/10.1177/0001848183034001004
Chen, Y. J. (2001b). Dimensions of transactional distance in Word Wide Web learning environment: A factor analysis. British Journal of Educational Technology, 52(4), 459-470. DOI: https://doi.org/10.1111/1467-8535.00213
Course, S. (2017). Reading strategies and reading diaries for autonomous learning in a Turkish context. The Reading Matrix: An International Online Journal, 17(1), 124-142.
Chemers, M. M., Hu, L., and Garcia, B. F. (2001). Academic self-efficacy and first-year college student performance and adjustment. Journal of Educational Psychology 93, 55-64. DOI: https://doi.org/10.1037//0022-0663.93.1.55
Ciekanski M. (2007). Fostering learner autonomy: power and reciprocity in the relationship between language learner and language learning adviser. Cambridge Journal of Education, 37(1), 111-127. DOI: https://doi.org/10.1080/03057640601179442
Çokluk, Ö., Şekercioğlu G. ve Büyüköztürk, Ş. (2018). Sosyal bilimler için çok değişkenli istatistik: SPSS ve LISREL uygulamaları. Ankara: Pegem Yayıncılık.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. DOI: https://doi.org/10.1207/S15328007SEM0902_5
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. DOI: https://doi.org/10.1080/10705510701301834
Candy P C 1991 Self-Direction for Lifelong Learning: A Comprehensive Guide to Theory and Practice. Jossey-Bass Publishers, San Francisco, CA Guglielmino L M 1989 Guglielmino responds to Field’s investigation. Adult Education Quarterly, 39(4), 235–240. DOI: https://doi.org/10.1177/0001848189039004005
Chwo, G. S-M. (2011). Cultivating learner autonomy in an EFL college level literature circle reading class via the author plus eLearning program. The International Journal of Learning, 18(2), 331- 355. DOI: https://doi.org/10.18848/1447-9494/CGP/v18i02/47488
Doğan, G. & Mirici, İ. H. (2017). EFL instructors’ perception and practices on learner autonomy in some Turkish universities. Journal of Language and Linguistic Studies, 13(1), 166-193.
Dosen, A. E. (2014). Learner autonomy and curriculum delivery in higher education: The case of university of Uyo, Nigeria. International Education Studies, 7(3), 40-50. DOI: https://doi.org/10.5539/ies.v7n3p40
Dubois, P., Guay, F., & St-Pierre, M. C. (2023). Examining the contribution of motivation in the job search of youth with developmental language disorder. Autism & developmental language impairments, 8, 23969415231152094. DOI: https://doi.org/10.1177/23969415231152094
Fisher, M., King, J., & Tague, G. (2001). Self-directed Learning Readiness Scale. Nurse Education Today, 21, 516-525. DOI: https://doi.org/10.1054/nedt.2001.0589
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. DOI: https://doi.org/10.1177/002224378101800104
Fatma Basri (2023) Factors influencing learner autonomy and autonomy support in a faculty of education, Teaching in Higher Education, 28(2), 270-285. DOI: https://doi.org/10.1080/13562517.2020.1798921
Guven, Z., & Sunbul, A. M. (2007). The relation between the learner’s autonomy level and their learning styles. Paper presented in International Conference on Quality in Education in the Balkan Countries. Thessaloniki, Greece.
Giagli, S., Giaglis, G., & Koutsouba, M. (2010). Autonomy in Learning in Distance Learning. Open Education Journal, 6(1&2), (pp. 93-106).
Garrison, D. R. (2000). Theoretical challenges for distance education in the 21st century: A shift from structural to transactional issues. International Review of Research in Open and Distance Learning, 1(1), (pp. 1-17). DOI: https://doi.org/10.19173/irrodl.v1i1.2
Galeano, R. A., Mirici, I., & Torres, K. M. (2013). Immigrant Parent vs. Immigrant Children Attitudes toward Language Learning in the US. Novitas-ROYAL, 18.
Gocić, M. P. S. ve Janković, A. V. (2021). Investigating learner autonomy of EFL and ESP students at the tertiary level: cross-sectional study. The journal of Teaching English for Specific and Academic Purposes, 9(4), 601-610. DOI: https://doi.org/10.22190/JTESAP2104601S
Griffiths, C. & Dikilitaş, K. (2022). Developing teacher and learner autonomy. The Journal of Language Teaching and Learning, 12(2), 21-35.
Großmann, N., Hofferber, N., Wilde, M. ve Basten, M. (2023). Students’ motivation in biology lessons-can student autonomy reduce the gender gap? European Journal of Psychology of Education, 38, 409–434. DOI: https://doi.org/10.1007/s10212-022-00604-1
Guglielmino, L. M. (1977). Development of the Self-directed Learning Readiness Scale. Unpublished doctoral dissertation, University of Georgia.
Guglielmino, L. M. (1977). Development of the Self-directed Learning Readiness Scale. Unpublished doctoral dissertation, University of Georgia.
Holec, H. (1981). Autonomy in foreign language learning. Oxford: Pergamon.
Hernández, A., Hidalgo, M. D., Hambleton, R. K. ve Gómez-Benito, J. (2020). International test commission guidelines for test adaptation: A criterion checklist. Psicothema, 32(3), 390-398.
Hair, J. F., Black, W. C., Babin, B. J. ve Anderson, R. E. (2014). Multivariate Data Analysis. UK: Pearson Education Limited.
Hayes, A. F. & Coutts J. J. (2020). Use Omega Rather than Cronbach’s Alpha for Estimating Reliability. But…. Communication Methods and Measures, 14(1), 1-24. DOI: https://doi.org/10.1080/19312458.2020.1718629
Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18(3-4), 117–144. DOI: https://doi.org/10.1080/03610739208253916
Johnson, R.A. and Wichern, D.W. (2007) Applied Multivariate Statistical Analysis. 6th Edition, Pearson Prentice Hall, Upper Saddle River.
Kleinkorres, R., Stand-Rabrig, J. ve McElvany, N. (2022). The longitudinal development of students' well-being in adolescence: The role of perceived teacher autonomy support. Journal of on Adolescence, 0, 1-18.
Kline, R. B. (2019). Yapısal eşitlik modellemesinin ilkeleri ve uygulaması. Ankara: Nobel Akademi Yayıncılık.
Kristmanson, P., Lafargue, C., & Culligan, K. (2013). Experiences with autonomy: Learners’ voices on language learning. The Canadian Modern Language Review, 69(4), 462-486. DOI: https://doi.org/10.3138/cmlr.1723.462
Lamb, T. E. (2011). Fragile Identities: Exploring Learner Identity, Learner Autonomy and Motivation through Young Learners’ Voices. The Canadian Journal of Applied Linguistics, 14(2), 68-85.
Le, H. ve Jia, J. (2022), "Öğrenen özerkliği açısından akıllı bir öğretim sisteminin tasarımı ve uygulanması", Interactive Technology and Smart Education , 19(4), 510-525. DOI: https://doi.org/10.1108/ITSE-12-2021-0210
Lenkaitis, C. A. (2020). Technology as a mediating tool: Videoconferencing, L2 learning, and learner autonomy. Computer Assisted Language Learning, 33(5-6), 483-509. DOI: https://doi.org/10.1080/09588221.2019.1572018
Little, D. (2004). Learner autonomy, teacher autonomy and the European Language Portfolio. Paper presented at the UNTELE, Université de Compiègne, 17-20 March 2004.
Lien, T. T. N. (2022). E-learning and learner autonomy in an EFL class in Vietnam. Language Teaching Research Quarterly, 27, 9-23. DOI: https://doi.org/10.32038/ltrq.2022.27.02
Long, H. B. (1989). Self-directed learning: emerging theory and practice. In H.B. Long & Associates (Eds.), Self-directed learning: Emerging theory and practice (pp.1-11).
Macaskill, A. & Taylor, E. (2010). The development of a brief measure of learner autonomy in university students. Studies in Higher Education, 35(3), 351-359. DOI: https://doi.org/10.1080/03075070903502703
Maryonita, B., Maay, J.K.R. 2023. Development of nursing learning program for COVID-19 patients with e-learning method for nursing department students Poltekkes Ministry of Health Jayapura Papua. Bali Medical Journal 12(1), 139-143.
Meri-Yilan, S. (2022). Exploring Student-Teacher Interaction and Learner Autonomy Through Writing Online Journals via Emails and Penzu: A Mixed-Method Analysis of Turkish Students’ Perceptions. In: Yangın-Ekşi, G., Akayoglu, S., Anyango, L. (eds) New Directions in Technology for Writing Instruction. English Language Education, vol 30. Springer. DOI: https://doi.org/10.1007/978-3-031-13540-8_16
Merriam, S. B., & Caffarella, R. S. (1999). Learning in adulthood: A comprehensive guide (2nd ed.). San Francisco: Jossey-Bass.
Millsap, R. E. (2011). Statistical approaches to measurement invariance. Routledge/Taylor & Francis Group. DOI: https://doi.org/10.4324/9780203821961
Moore, G. M. (1993). Theory of transactional distance. In D. Keegan (Ed.), Theoretical principles of distance education (pp.22-38). New York: Routledge.
Nhung, N. T. N. ve Yen, P. H. (2022). Online learning and its potential in developing EFL learner autonomy: Englısh-majored students' perceptions. European Journal of English Language Teaching, 7(6), 186-210. DOI: https://doi.org/10.46827/ejel.v7i6.4610
Nunan, D. (1997). The learner-centred curriculum. Cambridge: Cambridge University Press. Knowles M S 1975 Self-Directed Learning: A Guide for Learners and Teachers. Association Press, New York, NY.
Oxford, R. L. (2008). Hero with a thousand faces: Learning autonomy, learning strategies and learning tactics in independent language learning. In S. Hurd, & T. Lewis (Eds.), Language learning strategies in independent settings (pp.41-63). Clevedon: Multilingual Matters. DOI: https://doi.org/10.21832/9781847690999-005
Özer, Ö. ve Yükselir, C. (2021). learner autonomy in the Turkish EFL context: a meta-synthesis study of 2009-2019 qualitative research. Mehmet Akif Ersoy Üniversitesi Eğitim Fakültesi Dergisi, 58, 154-171.
Phuong,H. L. T., Huy, D. N. A. ve Lich, D. T. (2023). An investigation into the online assessment and the autonomy of non-English majored students in vinh long province. ICTE Conference Proceedings, 3, 41-51. DOI: https://doi.org/10.54855/ictep.2334
Ponton, M. K., Carr, P. B., and Confessore, G. J. (2000). Learning conation: A psychological perspective of personal initiative and resourcefulness. In H.B. Long & Associates (Eds.), Practice and theory in self-directed learning (pp.65-82). Schaumburg, IL: Motorola University Press.
Pratiwi, D. I., & Waluyo, B. (2023). Autonomous learning and the use of digital technologies in online English classrooms in higher education. Contemporary Educational Technology, 15(2), ep423. DOI: https://doi.org/10.30935/cedtech/13094
Rutkowski, L., & Svetina, D. (2014). Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educational and Psychological Measurement, 74(1), 31–57. DOI: https://doi.org/10.1177/0013164413498257
Sereti, S. ve Giossos, Y. (2018). Development of a Learner Autonomy Scale. Open Education - The Journal for Open and Distance Education and Educational Technology, 14(1), 94-103. DOI: https://doi.org/10.12681/jode.18212
Shahsavari, S. (2014). Efficiency, Feasibility and Desirability of Learner Autonomy Based on Teachers’ and Learners’ Point of Views. Theory and practice in language studies, 4(2), 271-280. DOI: https://doi.org/10.4304/tpls.4.2.271-280
Shih, H-C. J. (2020). The use of individual and collaborative learning logs and their impact on the development of learner autonomy in the EFL classroom in Taiwan. Innovation in Language Learning and Teaching, pp.1-15. DOI: https://doi.org/10.1080/17501229.2020.1737703
Stephenson, J., and Laycock, M. (1993). Using learner contracts in higher education. London: Kogan Page.
Stevani, M. ve Ginting, F. Y. A. (2022). English teachers’ perspectives of learner autonomy in online reading comprehension in times of the COVID-19 pandemic. Journal of Teaching and Learning in Elementary Education (JTLEE), 5(2), 166-189. DOI: https://doi.org/10.33578/jtlee.v5i2.7934
Someya, F. ve Obermeier, A. (2023). Autonomy Support, Psychological Needs Satisfaction, Academic Engagement, and Achievement in English Learning: Generating a Mediation Model. LET Kansai Chapter Collected Paper, 21, 19-38.
Susanti, A., Rachmajanti, S. ve Mustofa, A. (2023). Between teacher’ roles and students’ social: Learner autonomy in online learning for EFL students during the pandemic. Cogent Education, 10(1), 2204698. DOI: https://doi.org/10.1080/2331186X.2023.2204698
Şener B. & Mede E. (2023). Promoting learner autonomy and improving reflective thinking skills through reflective practice and collaborative learning. Innovation in Language Learning and Teaching, 17(2), 364-379. DOI: https://doi.org/10.1080/17501229.2022.2047694
Tabachnick, B. G.ve Fidell, L. S. (2015). Çok değişkenli istatistiklerin kullanımı. Baloğlu, M. (Çev.). Ankara: Nobel Yayınları.
Tavşancıl, E. (2010). Tutumların ölçülmesi ve SPSS ile veri analizi. Ankara: Nobel Yayıncılık.
Tran, T. Q. (2020). EFL students’ attitudes towards learner autonomy in English vocabulary learning. English Language Teaching Educational Journal, 3(2), 86-94. DOI: https://doi.org/10.12928/eltej.v3i2.2361
Van de Schoot, R., Lugtig, P. & Hox J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486-492. DOI: https://doi.org/10.1080/17405629.2012.686740
Vasiloudis, G., Koutsouba, M., Giossos, Y., & Mavroidis, I. (2015). Transactional distance and autonomy in a distance learning environment. European Journal of Open, Distance and e-Learning,18(1), 114- 1220. DOI: https://doi.org/10.1515/eurodl-2015-0008
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–69. DOI: https://doi.org/10.1177/109442810031002
Vázquez, B. M. (2018). Teacher development for autonomy: an exploratory review of language teacher education for learner and teacher autonomy. Innovation in Language Learning and Teaching, 12(4), 387-398. DOI: https://doi.org/10.1080/17501229.2016.1235171
Willis, J. (2011). Affiliation, autonomy and assessment for learning. Assessment in Education: Principles, Policy & Practice, 18(4), 399-415. DOI: https://doi.org/10.1080/0969594X.2011.604305
Walker, S. L., & Fraser, B. J. (2005). Development and Validation of an Instrument for Assessing Distance Education Learning Environments in Higher Education: The distance Education Learning Environments Survey (DELES). Learning Environments Research 8(3), 289-308. DOI: https://doi.org/10.1007/s10984-005-1568-3
Worthington, R. L., & Whittaker, T. A. (2006). Scale Development Research: A Content Analysis and Recommendations for Best Practices. The Counseling Psychologist, 34(6), 806–838. DOI: https://doi.org/10.1177/0011000006288127
Yıldırım, Ö. (2012). A study on a group of Indian English as a second language learners’ perceptions of autonomous learning. Turkish Online Journal of Qualitative Inquiry, 3(2), 18-29.
Yoon, M., & Kim, E. S. (2014). A comparison of sequential and nonsequential specification searches in testing factorial invariance. Behavior Research Methods, 46, 1199-1206. DOI: https://doi.org/10.3758/s13428-013-0430-2
Zhang, L.X. & Li X.X. (2004). A Comparative Study on Learner Autonomy between Chinese Students and West European Students. Foreign Language World, 4(1), 15–23.
Zimmerman, B. J. & Schunk, D. H. (1989). Self-regulated learning and academic achievement: Theory, research, and practice. New York: Springer-Verlag. DOI: https://doi.org/10.1007/978-1-4612-3618-4
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Emrullah Deniz, Hilal Kazu
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
