Measurement invairance and construct validity of the Turkish version of the learner autonomy scale in a sample of high and secondary school students


Abstract views: 32 / PDF downloads: 35

Authors

DOI:

https://doi.org/10.52380/ijcer.2024.11.1.477

Abstract

The goal of this research is to adapt the 24-item "Learner Autonomy Scale" developed by Sereti and Giossos (2018) in higher education samples into Turkish by examining the psychometric properties of high school and secondary school samples, and to determine whether these groups are equivalent in terms of measurement invariance. The scale was applied in high school (n = 475) and secondary school (n = 395) samples consisting of 870 students. Different from the original four-factor scale form, EFA applied to both groups revealed a two-factor (factor load range: .308-.775) and 21-item. Correlation values (r = .209-.392, p˂.001) indicate that the factors are not strongly related. The factors produced adequate internal consistency coefficients (α = .706-.866; ω = .708-.871) and were validated by meeting the fit indices accepted in the literature for CFA. Measurement invariance tests revealed strong invariance for the structural and metric tests and partial invariance for the scalar test in high school and secondary school samples. More research is needed to determine why the intersections of items 19, 20, and 21 are not invariant. The main contribution to "learner autonomy" in this study is the adaptation and justification of a valid and reliable measurement tool for determining autonomy in the adolescent age group. The use of the adapted scale in different educational environments and in the examination of "autonomy" by adapting it specific to the field (science, mathematics, etc.) will provide important implications for further theoretical studies.

References

Aminah, M., Maulida, I. ve Supriadi, T. F. (2023). Project based learning in promoting learner autonomy. Open Journal Systems, 17(7), 1511-1516.

Ahmadianzadeh, B., Seifoori, Z. ve Tamjid, H. H. (2020). Exploring EFL teachers’ beliefs about and practices of learner autonomy across experience and licensure. Innovation in Language Learning and Teaching, 14(1), 1-7.

Asparouhov, T., & Muthén, B. (2014). Auxiliary variables in mixture modeling: Three-step approaches using M plus . Structural Equation Modeling, 21(3), 329–341.

Anderson, T., & Dron, J. (2011). Three Generations of Distance Education Pedology. International Review of Research in Distance Learning, 12(3), 80-97.

Bei, E., Mavroidis, I. ve Giossos, Y. (2019). Development of a scale for measurıng the learner autonomy of dıstance educatıon students. European Journal of Open, Distance and e-Learning, 22(2), 133-144.

Bei, E. (2016). Developing a range of autonomy for students in the HOU. Unpublished Postgraduate Thesis. Patras: HOU.

Benson, P. (2001). Teaching and Researching Autonomy in Language Learning. Harlow: Longman.

Bekker, M.H.J., & Van Assen, M.A.L.M. (2006). A Short Form of the Autonomy Scale: Properties of the Autonomy – Connectedness Scale (ACS-30). Journal of personality assessment, 86(1), 51-60.

Basri F. (2023). Factors influencing learner autonomy and autonomy support in a faculty of education. Teaching in Higher Education, 28(2), 270-285.

Borg, S. ve Al-Busaidi, S. (2012). Teachers’ beliefs and practices regarding learner autonomy. ELT Journal, 66(3), 283-292.

Baharom, N., & Shaari, A.H. (2022). Portfolio based assessment and learner autonomy practice among ESL students. Journal of Language and Linguistic Studies, 18(Special Issue 2), 1289-1305.

Brown, T. A. (2006). Confirmatory factor analysis for applied research. The Guilford Press.

Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications and programming. New York: Routledge.

Burcu Şener & Enisa Mede (2023) Promoting learner autonomy and improving reflective thinking skills through reflective practice and collaborative learning, Innovation in Language Learning and Teaching, 17(2), 364-379.

Bryde, J. F., and Milburn, C. M. (1990). Helping to make the transition from school to college. In R. L. Emans (Ed.) Understanding undergraduate education (pp. 203-213). Vermillion, SD: University of South Dakota Press.

Chene, A. (1983). The concept of autonomy in adult education: a philosophical discussion. Adult Education Quarterly, 34(1), 38-47.

Chen, Y. J. (2001b). Dimensions of transactional distance in Word Wide Web learning environment: A factor analysis. British Journal of Educational Technology, 52(4), 459-470.

Course, S. (2017). Reading strategies and reading diaries for autonomous learning in a Turkish context. The Reading Matrix: An International Online Journal, 17(1), 124-142.

Chemers, M. M., Hu, L., and Garcia, B. F. (2001). Academic self-efficacy and first-year college student performance and adjustment. Journal of Educational Psychology 93, 55-64.

Ciekanski M. (2007). Fostering learner autonomy: power and reciprocity in the relationship between language learner and language learning adviser. Cambridge Journal of Education, 37(1), 111-127.

Çokluk, Ö., Şekercioğlu G. ve Büyüköztürk, Ş. (2018). Sosyal bilimler için çok değişkenli istatistik: SPSS ve LISREL uygulamaları. Ankara: Pegem Yayıncılık.

Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255.

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504.

Candy P C 1991 Self-Direction for Lifelong Learning: A Comprehensive Guide to Theory and Practice. Jossey-Bass Publishers, San Francisco, CA Guglielmino L M 1989 Guglielmino responds to Field’s investigation. Adult Education Quarterly, 39(4), 235–240.

Chwo, G. S-M. (2011). Cultivating learner autonomy in an EFL college level literature circle reading class via the author plus eLearning program. The International Journal of Learning, 18(2), 331- 355.

Doğan, G. & Mirici, İ. H. (2017). EFL instructors’ perception and practices on learner autonomy in some Turkish universities. Journal of Language and Linguistic Studies, 13(1), 166-193.

Dosen, A. E. (2014). Learner autonomy and curriculum delivery in higher education: The case of university of Uyo, Nigeria. International Education Studies, 7(3), 40-50.

Dubois, P., Guay, F., & St-Pierre, M. C. (2023). Examining the contribution of motivation in the job search of youth with developmental language disorder. Autism & developmental language impairments, 8, 23969415231152094.

Fisher, M., King, J., & Tague, G. (2001). Self-directed Learning Readiness Scale. Nurse Education Today, 21, 516-525.

Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50.

Fatma Basri (2023) Factors influencing learner autonomy and autonomy support in a faculty of education, Teaching in Higher Education, 28(2), 270-285.

Guven, Z., & Sunbul, A. M. (2007). The relation between the learner’s autonomy level and their learning styles. Paper presented in International Conference on Quality in Education in the Balkan Countries. Thessaloniki, Greece.

Giagli, S., Giaglis, G., & Koutsouba, M. (2010). Autonomy in Learning in Distance Learning. Open Education Journal, 6(1&2), (pp. 93-106).

Garrison, D. R. (2000). Theoretical challenges for distance education in the 21st century: A shift from structural to transactional issues. International Review of Research in Open and Distance Learning, 1(1), (pp. 1-17).

Galeano, R. A., Mirici, I., & Torres, K. M. (2013). Immigrant Parent vs. Immigrant Children Attitudes toward Language Learning in the US. Novitas-ROYAL, 18.

Gocić, M. P. S. ve Janković, A. V. (2021). Investigating learner autonomy of EFL and ESP students at the tertiary level: cross-sectional study. The journal of Teaching English for Specific and Academic Purposes, 9(4), 601-610.

Griffiths, C. & Dikilitaş, K. (2022). Developing teacher and learner autonomy. The Journal of Language Teaching and Learning, 12(2), 21-35.

Großmann, N., Hofferber, N., Wilde, M. ve Basten, M. (2023). Students’ motivation in biology lessons-can student autonomy reduce the gender gap? European Journal of Psychology of Education, 38, 409–434.

Guglielmino, L. M. (1977). Development of the Self-directed Learning Readiness Scale. Unpublished doctoral dissertation, University of Georgia.

Guglielmino, L. M. (1977). Development of the Self-directed Learning Readiness Scale. Unpublished doctoral dissertation, University of Georgia.

Holec, H. (1981). Autonomy in foreign language learning. Oxford: Pergamon.

Hernández, A., Hidalgo, M. D., Hambleton, R. K. ve Gómez-Benito, J. (2020). International test commission guidelines for test adaptation: A criterion checklist. Psicothema, 32(3), 390-398.

Hair, J. F., Black, W. C., Babin, B. J. ve Anderson, R. E. (2014). Multivariate Data Analysis. UK: Pearson Education Limited.

Hayes, A. F. & Coutts J. J. (2020). Use Omega Rather than Cronbach’s Alpha for Estimating Reliability. But…. Communication Methods and Measures, 14(1), 1-24.

Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18(3-4), 117–144.

Johnson, R.A. and Wichern, D.W. (2007) Applied Multivariate Statistical Analysis. 6th Edition, Pearson Prentice Hall, Upper Saddle River.

Kleinkorres, R., Stand-Rabrig, J. ve McElvany, N. (2022). The longitudinal development of students' well-being in adolescence: The role of perceived teacher autonomy support. Journal of on Adolescence, 0, 1-18.

Kline, R. B. (2019). Yapısal eşitlik modellemesinin ilkeleri ve uygulaması. Ankara: Nobel Akademi Yayıncılık.

Kristmanson, P., Lafargue, C., & Culligan, K. (2013). Experiences with autonomy: Learners’ voices on language learning. The Canadian Modern Language Review, 69(4), 462-486.

Lamb, T. E. (2011). Fragile Identities: Exploring Learner Identity, Learner Autonomy and Motivation through Young Learners’ Voices. The Canadian Journal of Applied Linguistics, 14(2), 68-85.

Le, H. ve Jia, J. (2022), "Öğrenen özerkliği açısından akıllı bir öğretim sisteminin tasarımı ve uygulanması", Interactive Technology and Smart Education , 19(4), 510-525.

Lenkaitis, C. A. (2020). Technology as a mediating tool: Videoconferencing, L2 learning, and learner autonomy. Computer Assisted Language Learning, 33(5-6), 483-509.

Little, D. (2004). Learner autonomy, teacher autonomy and the European Language Portfolio. Paper presented at the UNTELE, Université de Compiègne, 17-20 March 2004.

Lien, T. T. N. (2022). E-learning and learner autonomy in an EFL class in Vietnam. Language Teaching Research Quarterly, 27, 9-23.

Long, H. B. (1989). Self-directed learning: emerging theory and practice. In H.B. Long & Associates (Eds.), Self-directed learning: Emerging theory and practice (pp.1-11).

Macaskill, A. & Taylor, E. (2010). The development of a brief measure of learner autonomy in university students. Studies in Higher Education, 35(3), 351-359.

Maryonita, B., Maay, J.K.R. 2023. Development of nursing learning program for COVID-19 patients with e-learning method for nursing department students Poltekkes Ministry of Health Jayapura Papua. Bali Medical Journal 12(1), 139-143.

Meri-Yilan, S. (2022). Exploring Student-Teacher Interaction and Learner Autonomy Through Writing Online Journals via Emails and Penzu: A Mixed-Method Analysis of Turkish Students’ Perceptions. In: Yangın-Ekşi, G., Akayoglu, S., Anyango, L. (eds) New Directions in Technology for Writing Instruction. English Language Education, vol 30. Springer.

Merriam, S. B., & Caffarella, R. S. (1999). Learning in adulthood: A comprehensive guide (2nd ed.). San Francisco: Jossey-Bass.

Millsap, R. E. (2011). Statistical approaches to measurement invariance. Routledge/Taylor & Francis Group.

Moore, G. M. (1993). Theory of transactional distance. In D. Keegan (Ed.), Theoretical principles of distance education (pp.22-38). New York: Routledge.

Nhung, N. T. N. ve Yen, P. H. (2022). Online learning and its potential in developing EFL learner autonomy: Englısh-majored students' perceptions. European Journal of English Language Teaching, 7(6), 186-210.

Nunan, D. (1997). The learner-centred curriculum. Cambridge: Cambridge University Press. Knowles M S 1975 Self-Directed Learning: A Guide for Learners and Teachers. Association Press, New York, NY.

Oxford, R. L. (2008). Hero with a thousand faces: Learning autonomy, learning strategies and learning tactics in independent language learning. In S. Hurd, & T. Lewis (Eds.), Language learning strategies in independent settings (pp.41-63). Clevedon: Multilingual Matters.

Özer, Ö. ve Yükselir, C. (2021). learner autonomy in the Turkish EFL context: a meta-synthesis study of 2009-2019 qualitative research. Mehmet Akif Ersoy Üniversitesi Eğitim Fakültesi Dergisi, 58, 154-171.

Phuong,H. L. T., Huy, D. N. A. ve Lich, D. T. (2023). An investigation into the online assessment and the autonomy of non-English majored students in vinh long province. ICTE Conference Proceedings, 3, 41-51.

Ponton, M. K., Carr, P. B., and Confessore, G. J. (2000). Learning conation: A psychological perspective of personal initiative and resourcefulness. In H.B. Long & Associates (Eds.), Practice and theory in self-directed learning (pp.65-82). Schaumburg, IL: Motorola University Press.

Pratiwi, D. I., & Waluyo, B. (2023). Autonomous learning and the use of digital technologies in online English classrooms in higher education. Contemporary Educational Technology, 15(2), ep423.

Rutkowski, L., & Svetina, D. (2014). Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educational and Psychological Measurement, 74(1), 31–57.

Sereti, S. ve Giossos, Y. (2018). Development of a Learner Autonomy Scale. Open Education - The Journal for Open and Distance Education and Educational Technology, 14(1), 94-103.

Shahsavari, S. (2014). Efficiency, Feasibility and Desirability of Learner Autonomy Based on Teachers’ and Learners’ Point of Views. Theory and practice in language studies, 4(2), 271-280.

Shih, H-C. J. (2020). The use of individual and collaborative learning logs and their impact on the development of learner autonomy in the EFL classroom in Taiwan. Innovation in Language Learning and Teaching, pp.1-15.

Stephenson, J., and Laycock, M. (1993). Using learner contracts in higher education. London: Kogan Page.

Stevani, M. ve Ginting, F. Y. A. (2022). English teachers’ perspectives of learner autonomy in online reading comprehension in times of the COVID-19 pandemic. Journal of Teaching and Learning in Elementary Education (JTLEE), 5(2), 166-189.

Someya, F. ve Obermeier, A. (2023). Autonomy Support, Psychological Needs Satisfaction, Academic Engagement, and Achievement in English Learning: Generating a Mediation Model. LET Kansai Chapter Collected Paper, 21, 19-38.

Susanti, A., Rachmajanti, S. ve Mustofa, A. (2023). Between teacher’ roles and students’ social: Learner autonomy in online learning for EFL students during the pandemic. Cogent Education, 10(1), 2204698.

Şener B. & Mede E. (2023). Promoting learner autonomy and improving reflective thinking skills through reflective practice and collaborative learning. Innovation in Language Learning and Teaching, 17(2), 364-379.

Tabachnick, B. G.ve Fidell, L. S. (2015). Çok değişkenli istatistiklerin kullanımı. Baloğlu, M. (Çev.). Ankara: Nobel Yayınları.

Tavşancıl, E. (2010). Tutumların ölçülmesi ve SPSS ile veri analizi. Ankara: Nobel Yayıncılık.

Tran, T. Q. (2020). EFL students’ attitudes towards learner autonomy in English vocabulary learning. English Language Teaching Educational Journal, 3(2), 86-94.

Van de Schoot, R., Lugtig, P. & Hox J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486-492.

Vasiloudis, G., Koutsouba, M., Giossos, Y., & Mavroidis, I. (2015). Transactional distance and autonomy in a distance learning environment. European Journal of Open, Distance and e-Learning,18(1), 114- 1220.

Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–69.

Vázquez, B. M. (2018). Teacher development for autonomy: an exploratory review of language teacher education for learner and teacher autonomy. Innovation in Language Learning and Teaching, 12(4), 387-398.

Willis, J. (2011). Affiliation, autonomy and assessment for learning. Assessment in Education: Principles, Policy & Practice, 18(4), 399-415.

Walker, S. L., & Fraser, B. J. (2005). Development and Validation of an Instrument for Assessing Distance Education Learning Environments in Higher Education: The distance Education Learning Environments Survey (DELES). Learning Environments Research 8(3), 289-308.

Worthington, R. L., & Whittaker, T. A. (2006). Scale Development Research: A Content Analysis and Recommendations for Best Practices. The Counseling Psychologist, 34(6), 806–838.

Yıldırım, Ö. (2012). A study on a group of Indian English as a second language learners’ perceptions of autonomous learning. Turkish Online Journal of Qualitative Inquiry, 3(2), 18-29.

Yoon, M., & Kim, E. S. (2014). A comparison of sequential and nonsequential specification searches in testing factorial invariance. Behavior Research Methods, 46, 1199-1206.

Zhang, L.X. & Li X.X. (2004). A Comparative Study on Learner Autonomy between Chinese Students and West European Students. Foreign Language World, 4(1), 15–23.

Zimmerman, B. J. & Schunk, D. H. (1989). Self-regulated learning and academic achievement: Theory, research, and practice. New York: Springer-Verlag.

Downloads

Published

25.03.2024

How to Cite

Deniz, E., & Kazu, H. (2024). Measurement invairance and construct validity of the Turkish version of the learner autonomy scale in a sample of high and secondary school students. International Journal of Contemporary Educational Research, 11(1), 1–19. https://doi.org/10.52380/ijcer.2024.11.1.477

Issue

Section

Articles