From AI Feedback to Language Learning: The Effects of Generative AI Feedback on EFL Learners’ Revision Quality and Delayed Writing Performance
DOI:
https://doi.org/10.62497/irjai.274Keywords:
generative AI, ChatGPT, EFL writing, feedback, revision, delayed post-test, mixed methodsAbstract
Introduction. Generative artificial intelligence is increasingly used as a source of written feedback in second and foreign language writing. The central pedagogical question is no longer whether an AI system can identify or reformulate language problems, but whether learners can convert AI feedback into durable learning that remains visible when the tool is removed.
Objective. This study is designed to examine whether structured generative-AI feedback improves EFL learners’ revision quality and whether such improvement transfers to a delayed writing task completed without AI support. It also examines how learners evaluate, accept, reject, and act on AI feedback.
Method. A mixed-methods, three-arm intervention is proposed for approximately 90 university EFL writers. Participants will complete a baseline writing task and will be allocated to AI feedback, teacher feedback, or hybrid teacher-plus-AI feedback. Across eight weeks, learners will complete four feedback–revision cycles. Immediate post-intervention writing and a two-week delayed writing task will be assessed using an analytic writing rubric. Revision changes, feedback uptake, and learner interviews will provide complementary evidence.
Results. No empirical results are claimed at this manuscript stage because no study dataset was supplied. The planned analyses will compare change over time and between groups, estimate effect sizes and confidence intervals, examine the persistence of learning at delayed post-test, and identify qualitative patterns in feedback use.
Conclusion. The proposed design distinguishes short-term improvement in a revised text from evidence of retained writing development. It is intended to provide a stronger test of whether generative-AI feedback functions as a learning resource rather than simply as an editing service.
References
Hyland K, Hyland F. Feedback in second language writing: contexts and issues. 2nd ed. Cambridge: Cambridge University Press; 2019.
Bitchener J, Storch N. Written corrective feedback for L2 development. Bristol: Multilingual Matters; 2016.
Lee I. Teacher education on feedback in EFL writing: how, what and why. Teach Teach Educ. 2020;91:103043. doi:10.1016/j.tate.2020.103043.
Hattie J, Timperley H. The power of feedback. Rev Educ Res. 2007;77(1):81-112. doi:10.3102/003465430298487.
Carless D, Boud D. The development of student feedback literacy: enabling uptake of feedback. Assess Eval High Educ. 2018;43(8):1315-1325. doi:10.1080/02602938.2018.1463354.
Kasneci E, Sessler K, Küchemann S, Bannert M, Dementieva D, Fischer F, et al. ChatGPT for good? On opportunities and challenges of large language models for education. Learn Individ Differ. 2023;103:102274. doi:10.1016/j.lindif.2023.102274.
UNESCO. Guidance for generative AI in education and research. Paris: UNESCO; 2023.
Mahapatra S. Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study. Smart Learn Environ. 2024;11:9. doi:10.1186/s40561-024-00295-9.
Polakova P, Ivenz P. The impact of ChatGPT feedback on the development of EFL students’ writing skills. Cogent Educ. 2024;11(1):2410101. doi:10.1080/2331186X.2024.2410101.
Steiss J, Tate T, Graham S, Cruz J, Hebert MA, Wang J, et al. Comparing the quality of human and ChatGPT feedback of students’ writing. Learn Instr. 2024;91:101894. doi:10.1016/j.learninstruc.2024.101894.
Lin S, Crosthwaite P. The grass is not always greener: teacher vs. GPT-assisted written corrective feedback. System. 2024;127:103529. doi:10.1016/j.system.2024.103529.
Han J, Li M. Exploring ChatGPT-supported teacher feedback in the EFL context. System. 2024;126:103502. doi:10.1016/j.system.2024.103502.
Alsofyani AH, Barzanji AM. The effects of ChatGPT-generated feedback on Saudi EFL learners’ writing skills and perception at the tertiary level: a mixed-methods study. J Educ Comput Res. 2025;63(2):431-463. doi:10.1177/07356331241307297.
Zhang Z, Aubrey S, Huang X, Chiu TKF. The role of generative AI and hybrid feedback in improving L2 writing skills: a comparative study. Innov Lang Learn Teach. 2025. doi:10.1080/17501229.2025.2503890.
Mekheimer M. Generative AI-assisted feedback and EFL writing: a study on proficiency, revision frequency and writing quality. Discover Educ. 2025;4:170. doi:10.1007/s44217-025-00602-7.
Li B, Tan YL, Wang C, Lowell V. Two years of innovation: a systematic review of empirical generative AI research in language learning and teaching. Comput Educ Artif Intell. 2025;9:100445. doi:10.1016/j.caeai.2025.100445.
Yang Y, Hussin S, Hashim H. Revising with intelligence: ChatGPT feedback and its impact on EFL students’ revision and self-efficacy. Forum Linguist Stud. 2025;7(7):352-367. https://journals.bilpubgroup.com/index.php/fls/article/view/9845.
Kang D. Direct vs. reformulation feedback through ChatGPT on EFL learners’ writings. J Korea English Educ Soc. 2025;24(3):1-17. doi:10.18649/jkees.2025.24.3.1.
Barrot JS. Using ChatGPT for second language writing: pitfalls and potentials. Assessing Writing. 2023;57:100745. doi:10.1016/j.asw.2023.100745.
Stevenson M, Phakiti A. The effects of computer-generated feedback on the quality of writing. Assessing Writing. 2014;19:51-65. doi:10.1016/j.asw.2013.11.007.
Bitchener J, Ferris DR. Written corrective feedback in second language acquisition and writing. New York: Routledge; 2012.
Ferris DR. Second language writing research and written corrective feedback in SLA: intersections and practical applications. Stud Second Lang Acquis. 2010;32(2):181-201.
Sheen Y. Corrective feedback, individual differences and second language learning. Dordrecht: Springer; 2011.
Ellis R. A typology of written corrective feedback types. ELT J. 2009;63(2):97-107. doi:10.1093/elt/ccn023.
Brown HD, Abeywickrama P. Language assessment: principles and classroom practices. 3rd ed. White Plains: Pearson; 2019.
Norris JM, Ortega L. Effectiveness of L2 instruction: a research synthesis and quantitative meta-analysis. Lang Learn. 2000;50(3):417-528.
Scherer S, Graham S, Busse V. How effective is feedback for L1, L2, and FL learners’ writing? A meta-analysis. Learn Instr. 2024;93:101961. doi:10.1016/j.learninstruc.2024.101961.
Schulz KF, Altman DG, Moher D; CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332. doi:10.1136/bmj.c332.
Levitt HM, Bamberg M, Creswell JW, Frost DM, Josselson R, Suárez-Orozco C. Journal article reporting standards for qualitative primary, qualitative meta-analytic, and mixed methods research in psychology. Am Psychol. 2018;73(1):26-46. doi:10.1037/amp0000151.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77-101. doi:10.1191/1478088706qp063oa.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Lawrence Erlbaum Associates; 1988.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Esraa Abd Elnaser Mohamed Hassan (Author)

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.