Development and Validation of a Motivation Scale for English Listening
Abstract views: 108
/ 
PDF downloads: 69
DOI:
https://doi.org/10.52380/ijcer.2024.11.4.583Keywords:
Construct validity, Listening, Motivation, Scale developmentAbstract
Motivation is crucial in the pace and success of language learning, and the effect of motivation on language learning has been extensively studied. Many scales have been developed to measure the motivation levels of the students. However, there are a limited number of studies conducted to specifically measure the motivation towards English language listening in the EFL context. Motivation has become an important factor that increases success in listening in terms of metacognitive control of listening processes and comprehension outcomes. This study aims to develop a motivation scale specifically for assessing English listening skills among secondary school students. A 25-item questionnaire with five sub-factors has been developed as a result of an exploratory factor analysis of the responses provided by a sample of 294 Turkish secondary school students. Sub-factors have been named as "effort," "self-confidence," “travel and friendship," "unwillingness," and “lack of interest." These factors explain 56.938% of the total variance. Cronbach Alpha value of the scale is 0.898. The values of item-total and item-remaining correlation are significant (p < 0.01). Moreover, the item discrimination value obtained from the difference between mean points of 27% of the lower and upper groups is significant. Confirmatory factor analysis shows that the goodness of fit indexes is acceptable (RMSEA=0.047; AGFI=0.86; SRMR=0.060; CFI=0.91; NNFI=0.89, χ2/sd 1.55). The data also revealed evidence of the reliability and validity of the instrument. The potential uses of the questionnaire and implications for further research are discussed.
References
Alzamil, J. (2021) Listening skills: Important but difficult to learn. Arab World English Journal (AWEJ) 12(3), 366-374. http://dx.doi.org/10.2139/ssrn.3952957
Anjomshoa, L. & Sadighi, F. (2015). The importance of motivation in second language acquisition. International Journal on Studies in English Language and Literature (IJSELL), 3(2), 126-137. https://www.arcjournals.org/pdfs/ijsell/v3-i2/12.pdf.
Asmali, M. (2017). Young learners' attitudes and motivation to learn English. Novitas-ROYAL (Research on Youth and Language), 11(1), 53-68. https://files.eric.ed.gov/fulltext/EJ1167207.pdf.
Bagheri, M. & Karami, S. (2014). The effect of explicit teaching of listening strategies and gender on EFL learners' IELTS performance. Journal of Language Teaching and Research, 5(6), 1387-1392. https://doi.org/10.4304/jltr.5.6.1387-1392.
Bodie, G. D. (2011). The Active-Empathic Listening Scale (AELS): Conceptualization and evidence of validity within the interpersonal domain. Communication Quarterly, 59(3), 277-295. https://doi.org/10.1080/01463373.2011.583495.
Bodie, G. D. (2013). Issues in the measurement of listening. Communication Research Reports, 30(1), 76-84. https://doi.org/10.1080/08824096.2012.733981.
Bodie, G. D., Worthington, D. L. & Gearhart, C. C. (2013). The listening styles profile-revised (LSP-R): A scale revision and evidence for validity. Communication Quarterly, 61(1), 72-90. https://doi.org/10.1080/01463373.2012.720343.
Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). The Guilford Press.
Büyüköztürk, Ş. (2012). Sosyal bilimler için veri analizi el kitabı. Pegem Akademi Yayıncılık.
Carpenter, S. (2018). Ten steps in scale development and reporting: A guide for researchers. Communication Methods and Measures, 12(1), 25-44. https://doi.org/10.1080/19312458.2017.1396583.
Chon, Y. V. & Shin, T. (2019). Profile of second language learners’ metacognitive awareness and academic motivation for successful listening: A talent class analysis. Learning and Individual Differences, 70, 62-75. https://doi.org/10.1016/j.lindif.2019.01.007.
Çapık, C. (2014). Geçerlik ve güvenirlik çalışmalarında doğrulayıcı faktör analizinin kullanımı [Use of confirmatory factor analysis in validity and reliability studies]. Anadolu Hemşirelik ve Sağlık Bilimleri Dergisi, 17(3), 196-205. https://dergipark.org.tr/en/download/article-file/29691.
Clément, R. & Kruidenier, B. G. (1983). Orientations in second language acquisition: I. The effects of ethnicity, milieu and target language on their emergence. Language Learning, 33, 272–291. https://doi.org/10.1111/j.1467-1770.1983.tb00542.x
Crookes, G. & R. W. Schmidt. (1991). Motivation: Reopening the research agenda. Language Learning, 41, 469–512. https://doi.org/10.1111/j.1467-1770.1991.tb00690.x
Çokluk, Ö., Şekercioğlu, G. & Büyüköztürk, Ş. (2016). Sosyal bilimler için çok değişkenli istatistik (4. Baskı). Pegem Akademi Yayıncılık.
Dölek, O. & Yıldırım, İ. (2021). The listening motivation scale for secondary school students: A validity and reliability study. International Journal of Language Academy, 9(2), 1-16. http://dx.doi.org/10.29228/ijla.49839.
Dörnyei, Z. (1998). Motivation in second and foreign language learning. Language Teaching, 31, 117–35. https://doi.org/10.1017/S026144480001315X
Dörnyei, Z. & Ushioda, E. (2011). Teaching and researching motivation. Longman/Pearson.
Dörnyei, Z. (2001). New themes and approaches in second language motivation research. Annual Review of Applied Linguistics, 21, 43–59. https://doi.org/10.1017/S0267190501000034.
Drollinger, T., Comer, L. B. & Warrington, P. T. (2006). Development and validation of the active empathetic listening scale. Psychology & Marketing, 23(2), 161-180. https://doi.org/10.1002/mar.20105
Ellis, K. (2000). Perceived teacher confirmation. The development and validation of an instrument and two studies of the relationship to cognitive and affective learning. Human Communication Research, 26(2), 264-291. https://doi.org/10.1111/j.1468-2958.2000.tb00758.x
Flood, J., Lapp, D., Squire, J. R. & Jensen, J. M. (2003). Handbook of research on teaching the English language arts (2nd ed.). Mahwah, NJ: Erlb.
Fontana, P. C., Cohen, S. D. & Wolvin, A. D. (2015). Understanding listening competency: A systematic review of research scales. International Journal of Listening, 29(3), 148-176. https://doi.org/10.1080/10904018.2015.1015226
Ford, W. S. Z., Wolvin, A. D. & Chung, S. (2000). Students' self-perceived listening competencies in the basic speech communication course. International Journal of Listening, 14(1), 1-13. https://doi.org/10.1080/10904018.2000.10499032
Gardner, R. C. (1985). Social psychology and second language learning. Arnold.
Gardner, R. C. (2010). Motivation and second language acquisition: The socio-educational model. Peter Lang.
Gilson, C. M., Flowers, C. & Chang, W. H. (2022). The Teacher Listening Orientation Questionnaire: A Validity Study. International Journal of Listening, 1-15. https://doi.org/10.1080/10904018.2022.2098130
Goctu, R. (2016). The effects of motivation on listening skills of ELT students in Georgia (IBSU case). Smart Moves Journal IJELLH, 4(5), 65-79. https://doi.org/10.24113/ijellh.v4i5.1342
Guilloteaux, M. J. & Dörnyei, Z. (2008). Motivating language learners: A classroom‐oriented investigation of the effects of motivational strategies on student motivation. TESOL Quarterly, 42(1), 55-77. https://doi.org/10.1002/j.1545-7249.2008.tb00207.x
Harrington, D. (2004). Confirmatory factor analysis. Oxford University Press.
Ho, R. (2006). Handbook of univariate and multivariate data analysis and interpretation with SPSS. Taylor & Francis Group.
Kamaeva, R. B., Hussien, M., Rassouli, A., Al-Sudani, A. Q. A. S., Zaini, Q. & Haidari, M. M. F. (2022). Cultural awareness, listening comprehension, listening motivation, and attitude among EFL learners: A Gender-Based Mixed Method Study. Education Research International, 2022, 1-8. https://doi.org/10.1155/2022/8018675
Kassem, H. M. (2015). The Relationship between listening strategies used by Egyptian EFL college sophomores and their listening comprehension and self-efficacy. English Language Teaching, 8(2), 153-169. http://dx.doi.org/10.5539/elt.v8n2p153
Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). The Guilford Press.
Lai, H. Y. T. & Ting, K. Y. (2013). English language learners' perceptions of motivational changes. English Language Teaching, 6(8), 10-20. http://dx.doi.org/10.5539/elt.v6n8p10
Leech, N. L., Barrett, K. C. & Morgan, G. A. (2005). SPSS for intermediate statistics: Use and interpretation (2nd ed.). Lawrence Erlbaum Associates.
Mahmoud Ismail, A. & Taha Atta, H. (2022). Basic education EFL majors’ listening skills: An evaluative study. Sohag University International Journal of Educational Research, 5(5), 103-128. https://doi.org/10.21608/suijer.2022.214017
Mickelson, W. T. & Welch, S. A. (2013). Improving the performance of the listening competency scale: revision and validation. International Journal of Listening, 27(3), 157-171. https://doi.org/10.1080/10904018.2013.821355.
Mitu, R. K. (2019). Motivation triggers the attainment of second language acquisition: A theoretical and conceptual analysis. American Based Research Journal, 8(10), 22-30. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3585632.
Navarroza, A. H. (2013). Relationships among motivation orientations, metacognitive awareness and proficiency in L2 reading. (Unpublished Doctoral Thesis). De La Salle University, Manila.
Nga Thi, H. N. (2015). Some insights into listening strategies of learners of English as a foreign language in Vietnam. Language, Culture and Curriculum, 28, (3), 311-326. https://doi.org/10.1080/07908318.2015.1080721.
Noels, K.A., Pelletier, L., Clément, R. & Vallerand, R. (2000). Why are you learning a second language? Motivational orientations and self-determination theory. Language Learning, 50, 57–85. https://doi.org/10.1111/0023-8333.00111.
Norris-Holt, J. (2020). Motivation as a contributing factor in second language acquisition [Paper presentation]. The Asian Conference on Education/ACE 2020 Surviving & Thriving: Education in Times of Change, Tokyo, Japan.
Nowrouzi, S., Sim, T. S., Zareian, G. & Nimehchisalem, V. (2014). Self-perceived listening comprehension strategies used by Iranian EFL students. International Journal of Applied Linguistics and English Literature, 3(6), 35-41. https://doi.org/10.7575/aiac.ijalel.v.3n.6p.35.
Osada, N. (2004). Listening comprehension research: a brief review of the past thirty years. Dialogue, 3, 53-66. http://www.talk-waseda.net/dialogue/no03_2004/2004dialogue03_k4.pdf.
Papi, M. & Teimouri, Y. (2014). Language learner motivational types: A cluster analysis study. Language Learning, 64(3), 493-525. https://doi.org/10.1111/lang.12065.
Pearce, C. G., Johnson, I. W. & Barker, R. T. (2003). Assessment of the listening styles inventory: Progress in establishing reliability and validity. Journal of Business and Technical Communication, 17(1), 84-113. https://doi.org/10.1177/1050651902238546.
Pourhosein Gilakjani, A. & Ahmadi, M. (2011). A study of factors affecting EFL learners' English listening comprehension and the strategies for improvement. Journal of Language Teaching and Research, 2(5), 977-988. https://doi.org/10.4304/jltr.2.5.977-988.
Rost, M. (2014). Listening in a multilingual world: The challenges of second language (L2) listening. International Journal of Listening, 28(3), 131-148, https://doi.org/10.1080/10904018.2014.937895.
Ryan, R. M. & Deci, E. L. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25(1), 54-67. https://doi.org/10.1006/ceps.1999.1020.
Schermelleh-Engel, K., Moosbrugger, H. & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8(2), 23-74.
Schiller, E. & Dorner, H. (2022). Factors influencing senior learners’ language learning motivation. A Hungarian perspective. Journal of Adult Learning, Knowledge and Innovation, 5(1), 12-21. https://doi.org/10.1556/2059.2020.00003.
Singh, K. (2007). Quantitative social research methods. SAGE Publications.
Steiger, J. H. (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences, 42(5), 893-898. https://doi.org/10.1016/j.paid.2006.09.017
Tabachnick, B. G. & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Allyn and Bacon.
Tavşancıl, E. (2010). Tutumların ölçülmesi ve SPSS veri analizi (4. Baskı). Nobel Yayınları.
Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. APA.
Tsang, A. (2022). FL listening motivation, interest, linguistic self-confidence, and overall proficiency: A complete double mediation model. System, 108. https://doi.org/10.1016/j.system.2022.102833.
Urbina, S. (2004). Essentials of psychological testing. John Wiley & Sons, Inc.
Watson, K. W., Barker, L. L. & Weaver III, J. B. (1995). The listening styles profile (LSP-16): Development and validation of an instrument to assess four listening styles. International Journal of Listening, 9(1), 1-13. https://doi.org/10.1080/10904018.1995.10499138.
Weger Jr, H., Castle Bell, G., Minei, E. M. & Robinson, M. C. (2014). The relative effectiveness of active listening in initial interactions. International Journal of Listening, 28(1), 13-31. https://doi.org/10.1080/10904018.2013.813234.
Vallerand, R. J. (1997). Toward a hierarchical model of intrinsic and extrinsic motivation. In M. P. Zanna (Ed.), Advances in experimental social psychology (pp. 271–360). NY: Academic Press.
Vandergrift, L. (2005). Relationships among motivation orientations, metacognitive awareness and proficiency in L2 listening. Applied Linguistics, 26, 70–89. http://dx.doi.org/10.1093/applin/amh039.
Vandergrift, L., Goh, C. C., Mareschal, C. J. & Tafaghodtari, M. H. (2006). The metacognitive awareness listening questionnaire: Development and validation. Language Learning, 56(3), 431-462. https://doi.org/10.1111/j.1467-9922.2006.00373.x.
Zhang, W. S. (2007). Teach More Strategies in EFL College Listening Classroom. Online Submission, 4(3), 71-76. https://files.eric.ed.gov/fulltext/ED497486.pdf.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Nilda Hocaoglu, Gürbüz Ocak
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
