Argumentation and discourse analysis in the future intelligent systems of essay grading


Abstract views: 58 / PDF downloads: 32

Authors

DOI:

https://doi.org/10.52380/ijcer.2024.11.1.546

Keywords:

Artificial intelligence, Assessment, Distance learning, E-learning

Abstract

Intelligent systems of essay grading constitute important tools for educational technologies. They can significantly replace the manual scoring efforts and provide instructional feedback as well. These systems typically include two main parts: feature extractor and automatic grading model. The latter is generally based on computational and artificial intelligent methods. In this work, we focus on the features extraction part. More precisely, we focus on argumentation and discourse related-features, which constitute high level features. We discuss some state-of-the-art systems and analyse how argumentation and discourse analysis are used for extracting features and providing feedback.

References

Azmi, A. M., Al-Jouie, M. F., and Hussain, M. (2019). AAEE–Automated evaluation of students’ essays in Arabic language. Information Processing and Management, 56(5), 1736-1752.

Burstein, J. (2003a). The E-rater® scoring engine: Automated essay scoring with natural language processing.

Burstein, J., Marcu, D., and Knight, K. (2003b). Finding the WRITE stuff: Automatic identification of discourse structure in student essays. IEEE Intelligent Systems, 18(1), 32-39.

Cropley, D. H., and Marrone, R. L. (2022). Automated scoring of figural creativity using a convolutional neural network. Psychology of Aesthetics, Creativity, and the Arts.

Dasgupta, T., Naskar, A., Dey, L., and Saha, R. (2018, July). Augmenting textual qualitative features in deep convolution recurrent neural network for automatic essay scoring. In Proceedings of the 5th Workshop on Natural Language Processing Techniques for Educational Applications (pp. 93-102).

Feng, V. W., Lin, Z., and Hirst, G. (2014, August). The impact of deep hierarchical discourse structures in the evaluation of text coherence. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers (pp. 940-949).

Foltz, P. W., Laham, D., and Landauer, T. K. (1999). The intelligent essay assessor: Applications to educational technology. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning, 1(2), 939-944.

Hussein, M. A., Hassan, H., and Nassef, M. (2019). Automated language essay scoring systems: A literature review. PeerJ Computer Science, 5, e208.

Ke, Z., and Ng, V. (2019, August). Automated Essay Scoring: A Survey of the State of the Art. In IJCAI (Vol. 19, pp. 6300-6308).

Landauer, T. K. (2003). Automatic essay assessment. Assessment in education: Principles, policy and practice, 10(3), 295-308.

Mann, W. C., and Thompson, S. A. (1988). Rhetorical structure theory: Toward a functional theory of text organization. Text-interdisciplinary Journal for the Study of Discourse, 8(3), 243-281.

Nadeem, F., Nguyen, H., Liu, Y., and Ostendorf, M. (2019, August). Automated essay scoring with discourse-aware neural models. In Proceedings of the fourteenth workshop on innovative use of NLP for building educational applications (pp. 484-493).

Page, E. B. (1966). The imminence of... grading essays by computer. The Phi Delta Kappan, 47(5), 238-243.

Persing, I., and Ng, V. (2015, July). Modeling argument strength in student essays. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (pp. 543-552).

Putra, J. W. G., Teufel, S., & Tokunaga, T. (2022). Annotating argumentative structure in English-as-a-Foreign-Language learner essays. Natural Language Engineering, 28(6), 797-823.

Ramesh, D., and Sanampudi, S. K. (2022). An automated essay scoring system: a systematic literature review. Artificial Intelligence Review, 55(3), 2495-2527.

Song, W., Wang, D., Fu, R., Liu, L., Liu, T., and Hu, G. (2017, July). Discourse mode identification in essays. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 112-122).

Stab, C., and Gurevych, I. (2014, October). Identifying argumentative discourse structures in persuasive essays. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) (pp. 46-56).

Uto, M. (2021). A review of deep-neural automated essay scoring models. Behaviormetrika, 48(2), 459-484.

Wambsganss, T., and Niklaus, C. (2022, May). Modeling persuasive discourse to adaptively support students’ argumentative writing. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 8748-8760).

Wambsganss, T., Kueng, T., Soellner, M., and Leimeister, J. M. (2021, May). ArgueTutor: An adaptive dialog-based learning system for argumentation skills. In Proceedings of the 2021 CHI conference on human factors in computing systems (pp. 1-13).

Wang, X., Lee, Y., and Park, J. (2022). Automated Evaluation for Student Argumentative Writing: A Survey. arXiv preprint arXiv:2205.04083.

Wang, X., Bruno, J., Molloy, H., Evanini, K., and Zechner, K. (2017, July). Discourse annotation of non-native spontaneous spoken responses using the rhetorical structure theory framework. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) (pp. 263-268).

Wang, X., Gyawali, B., Bruno, J. V., Molloy, H. R., Evanini, K., and Zechner, K. (2019, June). Using Rhetorical Structure Theory to assess discourse coherence for non-native spontaneous speech. In Proceedings of the Workshop on Discourse Relation Parsing and Treebanking 2019 (pp. 153-162).

Downloads

Published

25.03.2024

How to Cite

Debbar, N. (2024). Argumentation and discourse analysis in the future intelligent systems of essay grading. International Journal of Contemporary Educational Research, 11(1), 29–35. https://doi.org/10.52380/ijcer.2024.11.1.546

Issue

Section

Articles