Training Students to Identify and Correct Fabricated References in ChatGPT-Generated Literature Reviews
DOI:
https://doi.org/10.24090/celti.2025.1335Keywords:
ChatGPT, Generative AI, Targeted Training, AI HallucinationsAbstract
The widespread use of generative AI tools such as ChatGPT among university students has introduced new challenges to academic integrity, particularly in the form of hallucinated citations: fabricated references that appear plausible but cannot be verified. This study investigates the effectiveness of a targeted instructional intervention in improving students' ability to identify and correct such false citations. A total of 139 students applied to participate through online recruitment; 50 were selected, 34 attended the training, and 27 completed both pre- and post-tests. The intervention consisted of a three-hour online session conducted via Zoom, where students were trained in responsible AI use, APA 7th citation formatting, and reference verification techniques. Pre- and post-tests required students to write short literature reviews using AI tools, and their submissions were assessed based on four indicators: the number of hallucinated sources, non-journal citations, reputable journal references, and APA formatting errors. Results revealed a significant reduction in fabricated and low-quality references, along with an increase in the use of reputable sources and improved citation formatting. These findings align with previous research emphasizing the risks of uncritical AI use and the importance of digital literacy education. The study concludes that targeted training is an effective method for mitigating citation hallucinations and enhancing students’ academic writing skills. The research highlights the necessity of integrating AI literacy into academic curricula to ensure ethical and effective engagement with emerging technologies in higher education.
References
Aljuaid, H. (2024). The impact of artificial intelligence tools on academic writing instruction in higher education: A systematic review. Arab World English Journal (AWEJ) Special Issue on ChatGPT. https://ssrn.com/abstract=4814342
AlZaabi, A., ALAmri, A., Albalushi, H., Aljabri, R., & AlAbdulsalam, A. A. (2023). ChatGPT applications in academic research: A review of benefits, concerns, and recommendations. bioRxiv. https://doi.org/10.1101/2023.08.17.553688
Buchanan, J., Hill, S., & Shapoval, O. (2023). ChatGPT hallucinates non-existent citations: Evidence from economics. The American Economist. https://doi.org/10.1177/05694345231218454
Cheng, A., Calhoun, A., & Reedy, G. (2025). Artificial intelligence-assisted academic writing: recommendations for ethical use. Advances in Simulation, 10(1), 22. https://doi.org/10.1186/s41077-025-00350-6
Coetzer, Z., & van Aardt, P. V. (2024). Unsilencing the student voice: Detecting and addressing ChatGPT-generated texts presented as student-authored texts at a university writing centre. International Journal of Critical Diversity Studies, 6(2), 151–174. https://doi.org/10.13169/intecritdivestud.6.2.00151
Day, T. (2023). A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. The Professional Geographer, 75(4), 1024–1027. https://doi.org/10.1080/00330124.2023.2190373
Duong, N. H., Tong, T. M. H., & Le, D. (2024). Utilizing ChatGPT in checking academic writing for postgraduate students. Proceedings of the AsiaCALL International Conference. https://doi.org/10.54855/paic.24614
Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition & Communication, 32(4), 365-387. https://doi.org/10.58680/ccc198115885
Franzoni Velázquez, A. L., Huerta, E., & Jensen, S. (2024). Retracting ChatGPT: Completeness and relevance of academic references. Discover Education. https://doi.org/10.1007/s44217-024-00333-1
Godwin-Jones, R. (2018). Using mobile technology to develop language skills and cultural understanding. Language Learning & Technology, 22(3), 104–120. https://www.lltjournal.org/item/2999
Hampel, R., & Stickler, U. (2012). The use of videoconferencing to support multimodal interaction in an online language classroom. ReCALL, 24(2), 116–137. https://doi.org/10.1017/S095834401200002X
Khalifa, M., & Albadawy, M. (2024). Using artificial intelligence in academic writing and research: An essential productivity tool. Computer Methods and Programs in Biomedicine Update, 100145. https://doi.org/10.1016/j.cmpbup.2024.100145
Jarrah, A. M., Wardat, Y., & Fidalgo, P. (2023). Using ChatGPT in academic writing is (not) a form of plagiarism: What does the literature say? Online Journal of Communication and Media Technologies. https://doi.org/10.30935/ojcmt/13572
Janković, A., & Kulić, D. (2025). Use and misuse of ChatGPT in academic writing among the English language students. Information Technologies and Learning Tools, 105(1). https://doi.org/10.33407/itlt.v105i1.5955
Lingard, L. (2023). Writing with ChatGPT: An illustration of its capacity, limitations & implications for academic writers. Perspectives on medical education, 12(1), 261. https://doi.org/10.5334/pme.1072
Mackey, A., & Gass, S. M. (2016). Second language research: Methodology and design (2nd ed.). Routledge.
Martin, J. R., & White, P. R. R. (2005). The language of evaluation: Appraisal in English. Palgrave Macmillan.
Medina, W. A. A., Velásquez, C. H. F., Zegarra, S. D. R. O., Romero, G. P. M., Andía, A. Q., Bellido, I. E. A., ... & Bravo, N. A. (2024). Using ChatGPT in University Academic Writing: A Bibliometric Review Study on the Implications for Writing Reports, Papers, Essays, and Theses. International Journal of Learning, Teaching and Educational Research, 23(12), 360-381. https://doi.org/10.26803/ijlter.23.12.19
Nunan, D. (1992). Research methods in language learning. Cambridge University Press.
Rashidov, A. (2024). Automating citation formatting in scientific publications using ChatGPT. 2024 Asian Conference on Communication and Networks (ASIANComNet), 1–6. https://doi.org/10.1109/asiancomnet63184.2024.10811018
Walters, W. H., & Wilder, E. I. (2023). Fabrication and errors in the bibliographic citations generated by ChatGPT. Scientific Reports, 13, Article 12856. https://doi.org/10.1038/s41598-023-41032-5
Weigle, S. C. (2002). Assessing writing. Cambridge University Press.
Wu, R. T., & Dang, R. (2023). ChatGPT in head and neck scientific writing: A precautionary anecdote. American Journal of Otolaryngology, 44(6), 103980. https://doi.org/10.1016/j.amjoto.2023.103980
Xu, T., & Jumaat, N. F. (2024). ChatGPT-empowered writing strategies in EFL students’ academic writing: Calibre, challenges and chances. International Journal of Interactive Mobile Technologies (iJIM), 18(15). https://doi.org/10.3991/ijim.v18i15.49219
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Hendi Pratama
This work is licensed under a Creative Commons Attribution 4.0 International License.
