Argumentation and discourse analysis in the future intelligent systems of essay grading
Abstract views: 165
/ 
PDF downloads: 100
DOI:
https://doi.org/10.52380/ijcer.2024.11.1.546Keywords:
Artificial intelligence, Assessment, Distance learning, E-learningAbstract
Intelligent systems of essay grading constitute important tools for educational technologies. They can significantly replace the manual scoring efforts and provide instructional feedback as well. These systems typically include two main parts: feature extractor and automatic grading model. The latter is generally based on computational and artificial intelligent methods. In this work, we focus on the features extraction part. More precisely, we focus on argumentation and discourse related-features, which constitute high level features. We discuss some state-of-the-art systems and analyse how argumentation and discourse analysis are used for extracting features and providing feedback.
References
Azmi, A. M., Al-Jouie, M. F., and Hussain, M. (2019). AAEE–Automated evaluation of students’ essays in Arabic language. Information Processing and Management, 56(5), 1736-1752. DOI: https://doi.org/10.1016/j.ipm.2019.05.008
Burstein, J. (2003a). The E-rater® scoring engine: Automated essay scoring with natural language processing.
Burstein, J., Marcu, D., and Knight, K. (2003b). Finding the WRITE stuff: Automatic identification of discourse structure in student essays. IEEE Intelligent Systems, 18(1), 32-39. DOI: https://doi.org/10.1109/MIS.2003.1179191
Cropley, D. H., and Marrone, R. L. (2022). Automated scoring of figural creativity using a convolutional neural network. Psychology of Aesthetics, Creativity, and the Arts. DOI: https://doi.org/10.1037/aca0000510
Dasgupta, T., Naskar, A., Dey, L., and Saha, R. (2018, July). Augmenting textual qualitative features in deep convolution recurrent neural network for automatic essay scoring. In Proceedings of the 5th Workshop on Natural Language Processing Techniques for Educational Applications (pp. 93-102). DOI: https://doi.org/10.18653/v1/W18-3713
Feng, V. W., Lin, Z., and Hirst, G. (2014, August). The impact of deep hierarchical discourse structures in the evaluation of text coherence. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers (pp. 940-949).
Foltz, P. W., Laham, D., and Landauer, T. K. (1999). The intelligent essay assessor: Applications to educational technology. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning, 1(2), 939-944.
Hussein, M. A., Hassan, H., and Nassef, M. (2019). Automated language essay scoring systems: A literature review. PeerJ Computer Science, 5, e208. DOI: https://doi.org/10.7717/peerj-cs.208
Ke, Z., and Ng, V. (2019, August). Automated Essay Scoring: A Survey of the State of the Art. In IJCAI (Vol. 19, pp. 6300-6308). DOI: https://doi.org/10.24963/ijcai.2019/879
Landauer, T. K. (2003). Automatic essay assessment. Assessment in education: Principles, policy and practice, 10(3), 295-308. DOI: https://doi.org/10.1080/0969594032000148154
Mann, W. C., and Thompson, S. A. (1988). Rhetorical structure theory: Toward a functional theory of text organization. Text-interdisciplinary Journal for the Study of Discourse, 8(3), 243-281. DOI: https://doi.org/10.1515/text.1.1988.8.3.243
Nadeem, F., Nguyen, H., Liu, Y., and Ostendorf, M. (2019, August). Automated essay scoring with discourse-aware neural models. In Proceedings of the fourteenth workshop on innovative use of NLP for building educational applications (pp. 484-493). DOI: https://doi.org/10.18653/v1/W19-4450
Page, E. B. (1966). The imminence of... grading essays by computer. The Phi Delta Kappan, 47(5), 238-243.
Persing, I., and Ng, V. (2015, July). Modeling argument strength in student essays. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (pp. 543-552). DOI: https://doi.org/10.3115/v1/P15-1053
Putra, J. W. G., Teufel, S., & Tokunaga, T. (2022). Annotating argumentative structure in English-as-a-Foreign-Language learner essays. Natural Language Engineering, 28(6), 797-823. DOI: https://doi.org/10.1017/S1351324921000218
Ramesh, D., and Sanampudi, S. K. (2022). An automated essay scoring system: a systematic literature review. Artificial Intelligence Review, 55(3), 2495-2527. DOI: https://doi.org/10.1007/s10462-021-10068-2
Song, W., Wang, D., Fu, R., Liu, L., Liu, T., and Hu, G. (2017, July). Discourse mode identification in essays. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 112-122). DOI: https://doi.org/10.18653/v1/P17-1011
Stab, C., and Gurevych, I. (2014, October). Identifying argumentative discourse structures in persuasive essays. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) (pp. 46-56). DOI: https://doi.org/10.3115/v1/D14-1006
Uto, M. (2021). A review of deep-neural automated essay scoring models. Behaviormetrika, 48(2), 459-484. DOI: https://doi.org/10.1007/s41237-021-00142-y
Wambsganss, T., and Niklaus, C. (2022, May). Modeling persuasive discourse to adaptively support students’ argumentative writing. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 8748-8760). DOI: https://doi.org/10.18653/v1/2022.acl-long.599
Wambsganss, T., Kueng, T., Soellner, M., and Leimeister, J. M. (2021, May). ArgueTutor: An adaptive dialog-based learning system for argumentation skills. In Proceedings of the 2021 CHI conference on human factors in computing systems (pp. 1-13). DOI: https://doi.org/10.1145/3411764.3445781
Wang, X., Lee, Y., and Park, J. (2022). Automated Evaluation for Student Argumentative Writing: A Survey. arXiv preprint arXiv:2205.04083.
Wang, X., Bruno, J., Molloy, H., Evanini, K., and Zechner, K. (2017, July). Discourse annotation of non-native spontaneous spoken responses using the rhetorical structure theory framework. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) (pp. 263-268). DOI: https://doi.org/10.18653/v1/P17-2041
Wang, X., Gyawali, B., Bruno, J. V., Molloy, H. R., Evanini, K., and Zechner, K. (2019, June). Using Rhetorical Structure Theory to assess discourse coherence for non-native spontaneous speech. In Proceedings of the Workshop on Discourse Relation Parsing and Treebanking 2019 (pp. 153-162). DOI: https://doi.org/10.18653/v1/W19-2719
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Naima Debbar
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
