Assessing the Impact of ChatGPT on EFL Students’ Writing Productivity and Proficiency
DOI:
https://doi.org/10.17507/jltr.1603.29Keywords:
ChatGPT, AI, writing productivity, writing proficiencyAbstract
With an emphasis on its effects on students' writing productivity and proficiency, this study investigates the effects of incorporating ChatGPT, an AI-based tool, into English as a Foreign Language (EFL) course. The research was conducted with 52 Saudi female university students and employed a pretest-posttest design to evaluate changes in key writing skills, including topic sentence formation, organization, use of supporting details, mechanics, and word count. Results revealed noticeable improvements in students’ writing proficiency, particularly in generating effective topic sentences and providing related details, while the impact on mechanics and organization was less pronounced. The findings highlight ChatGPT's potential as a helpful tool for beginning EFL learners, assisting with idea generation, reducing redundancy, and fostering writing clarity. However, the study underscores the need for judicious application to avoid overreliance and ensure students develop essential writing skills independently. These insights contribute to advancing AI integration in EFL contexts and align with Saudi Vision 2030’s emphasis on technological innovation in learning environments.
References
Abouammoh, N., Alhasan, K., Raina, R., Malki, K., Aljamaan, F., Tamimi, I., Muaygil, R., Wahabi, H., Jamal, A., Al-Tawfiq, J., Al-Eyadhy, A., Soliman, M., & Temsah, M.-H. (2023). Exploring Perceptions and Experiences of ChatGPT in Medical Education: A Qualitative Study Among Medical College Faculty and Students in Saudi Arabi. https://doi.org/10.1101/2023.07.13.23292624
Ahmadi, D. M. R. (2018). The Use of Technology in English Language Learning: A Literature Review. International Journal of Research in English Education, 3(2), 115–125. https://doi.org/10.29252/ijree.3.2.115
Al-Garaady, J., & Mahyoob, M. (2023). ChatGPT's capabilities in spotting and analyzing writing errors experienced by EFL learners. Arab World English Journals, Special Issue on CALL, (9).
Akpur, A., & Enes, K. (2024). Evaluating ChatGPT's Role in Assessing Turkey's Medical Tourism Trends. Jordan Medical Journal, 58(4).
Almelhes, S. A. (2023). A Review of Artificial Intelligence Adoption in Second-Language Learning. Theory and Practice in Language Studies, 13(5), Article 5. https://doi.org/10.17507/tpls.1305.21
Alneyadi, S., & Wardat, Y. (2023). ChatGPT: Revolutionizing student achievement in the electronic magnetism unit for eleventh-grade students in Emirates schools. Contemporary Educational Technology, 15(4), ep448. https://doi.org/10.30935/cedtech/13417
Al-Rashidi, A. H., Asif, M., Vanani, M. G., & Aberash, A. (2022). Learner-oriented assessment (LOA) practice: The comparative study of self-assessment, peer assessment, and teacher assessment on EFL learners’ writing complicity, accuracy, and fluency (CAF), speaking CAF, and attitude. Language Testing in Asia, 12(1), 59. https://doi.org/10.1186/s40468-022-00209-x
Alsmari, N. A. (2022). Integrating Computer-aided Argument Mapping into EFL Learners’ Argumentative Writing: Evidence from Saudi Arabia. International Journal of Advanced Computer Science and Applications (IJACSA), 13(10), Article 10. https://doi.org/10.14569/IJACSA.2022.0131013
Boudouaia, A., Mouas, S., & Kouider, B. (2024). A Study on ChatGPT-4 as an Innovative Approach to Enhancing English as a Foreign Language Writing Learning. Journal of Educational Computing Research, 07356331241247465. https://doi.org/10.1177/07356331241247465
Brown, G. T. L., Irving, S. E., & Keegan, P. J. (2007). An Introduction to Educational Assessment, Measurement and Evaluation: Improving the Quality of Teacher-Based Assessment. Pearson.
Cox, C., & Tzoc, E. (2023). ChatGPT: Implications for academic libraries | Cox | College & Research Libraries News. https://doi.org/10.5860/crln.84.3.99
Dai, J., Wang, L., & He, Y. (2023). Exploring the effect of wiki-based writing instruction on writing skills and writing self-efficacy of Chinese English-as-a-foreign language learners. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.1069832
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023). ChatGPT and the rise of large language models: The new AI-driven infodemic threat in public health. Frontiers in Public Health, 11. https://doi.org/10.3389/fpubh.2023.1166120
Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: Insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20(1), 57. https://doi.org/10.1186/s41239-023-00425-2
Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023). ChatGPT - Reshaping medical education and clinical management. Pakistan Journal of Medical Sciences, 39(2), Article 2. https://doi.org/10.12669/pjms.39.2.7653
Kovačević, D. (2023). Use of ChatGPT in ESP Teaching Process. 2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH), 1–5. https://doi.org/10.1109/INFOTEH57020.2023.10094133
Lira-Gonzales, M.-L., Wa Chao Chao, K., David, J., Lira-Gonzales, M.-L., Wa Chao Chao, K., & David, J. (2023). Technologies in English as a Second/Foreign Language Writing Classes. Folios, 58, 171–187. https://doi.org/10.17227/folios.58-16435
Liu, G.-Z., Rahimi, M., & Fathi, J. (2022). Flipping writing metacognitive strategies and writing skills in an English as a foreign language collaborative writing context: A mixed-methods study. Journal of Computer Assisted Learning, 38(6), 1730–1751. https://doi.org/10.1111/jcal.12707
Mahmud, F. A. (2023). Investigating EFL Students’ Writing Skills Through Artificial Intelligence: Wordtune Application as a Tool. Journal of Language Teaching and Research, 14(5), Article 5. https://doi.org/10.17507/jltr.1405.28
Mohammed, A. A. Q., Al-ghazali, A., & Alqohfa, K. A. S. (2023). Exploring ChatGPT Uses in Higher Studies: A Case Study of Arab Postgraduates in India. Journal of English Studies in Arabia Felix, 2(2), Article 2. https://doi.org/10.56540/jesaf.v2i2.55
Moqbel, M. S. S., & Al-Kadi, A. M. T. (2023). Foreign Language Learning Assessment in the Age of ChatGPT: A Theoretical Account. Journal of English Studies in Arabia Felix, 2(1), 71–84. https://doi.org/10.56540/jesaf.v2i1.62
Mudawy, A. M. A. (2024). Investigating EFL Faculty Members’ Perceptions of Integrating Artificial Intelligence Applications to Improve the Research Writing Process: A Case Study at Majmaah University. OSF. https://doi.org/10.31235/osf.io/k4ub8
Nguyen Thi Thu, H. (2023). EFL teachers’ perspectives toward the use of ChatGPT in writing classes: A case study at Van Lang University. Nguyen, TTH (2023). EFL Teachers’ Perspectives toward the Use of ChatGPT in Writing Classes: A Case Study at Van Lang University. International Journal of Language Instruction, 2(3), 1-47.
Nguyen-Trung, K., Saeri, A., & Kaufman, S. (2023). Applying ChatGPT and AI-powered tools to accelerate evidence reviews. https://doi.org/10.31219/osf.io/pcrqf
Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187–192. https://doi.org/10.1126/science.adh2586
Oh, N., Choi, G. S., & Lee, W. Y. (2023). ChatGPT goes to the operating room: evaluating GPT-4 performance and its potential in surgical education and training in the era of large language models. Annals of Surgical Treatment and Research, 104(5), 269-273.
Qadir, J. (2023). Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education. 2023 IEEE Global Engineering Education Conference (EDUCON), 1–9. https://doi.org/10.1109/EDUCON54358.2023.10125121
Rahmatunisa, W. (2014). Problems Faced by Indonesian EFL Learners in Writing Argumentative Essay. English Review: Journal of English Education, 3(1), 41–49.
Roe, J., Renandya, W., & Jacobs, G. (2023). A Review of AI-Powered Writing Tools and Their Implications for Academic Integrity in the Language Classroom. Journal of English and Applied Linguistics, 2(1). https://doi.org/10.59588/2961-3094.1035
Roman, A., Al-Sharif, L., & Gharyani, M. A. (2023). The expanding role of ChatGPT (Chat-Generative Pre-Trained Transformer) in neurosurgery: a systematic review of literature and conceptual framework. Cureus, 15(8).
Sari, Y. P., Quthny, A. Y. A., & Hamdani, B. (2024). “I Get Blank When I Start Writing’’ Analysis of EFL Student’s Anxiety in Writing Descriptive Text. Journey: Journal of English Language and Pedagogy, 7(1), Article 1. https://doi.org/10.33503/journey.v7i1.4016
Sun, J., Motevalli, S., & Chan, N. N. (2024). Exploring Writing Anxiety during Writing Process: An Analysis of Perceptions in Chinese English as a Foreign Language (EFL) Learners. Qualitative Research in Education, 1–16. https://doi.org/10.17583/qre.12938
Wang, W., Duan, M., & Zhang, H. (2023). Corpus-based Development of Syntactic Complexity in EFL Writing. SHS Web of Conferences, 152, 04001. https://doi.org/10.1051/shsconf/202315204001
Yesuf, M. Y., & Anshu, A. H. (2022). The Impact of the Use of Collaborative Writing on Attitude of EFL Students towards Learning Writing Skills. International Journal of Education and Literacy Studies, 10(3), 113–120. https://doi.org/10.7575/aiac.ijels.v.10n.3p.113
Zhang, B. (2023). ChatGPT, an Opportunity to Understand More About Language Models. Medical Reference Services Quarterly, 42(2), 194–201. https://doi.org/10.1080/02763869.2023.2194149
Zhao, X. (2023). Leveraging Artificial Intelligence (AI) Technology for English Writing: Introducing Wordtune as a Digital Writing Assistant for EFL Writers. RELC Journal, 54(3), 890–894. https://doi.org/10.1177/00336882221094089
