On December 30, 2024, Anna Radtke and Nikol Rummel published an article in Computers and Education: Artificial Intelligence. The article presents empirical findings on the correction behavior of learners when editing AI texts.
The results revealed differences in the amount of time learners spent revising AI-generated content compared to their revision behaviors when revising peer-written texts. Namely, participants revised faster when they were informed that a text was written by an AI. However, we did not find significant differences in terms of learners’ actual editing of supposedly peer-written and AI-generated texts (number of changes made to the text).
Abstract:
The role of generative artificial intelligence (AI) in education has expanded significantly over recent years. AI-based text generators such as ChatGPT provide an accessible and effective tool for learners, particularly in academic writing. While revision is considered an essential part of both individual and collaborative writing, research on the revision of AI-generated texts remains limited. However, with the growing adoption of generative AI in education, learners’ ability to effectively revise AI-generated content is likely to become increasingly important in the future. The aim of this study was to investigate whether learners exhibit different revision behaviors when presented with different information about the author of a text (peer vs. AI). We further examined the impact of learners’ prior experiences, attitudes, and gender on text revision. Therefore, N = 303 learners revised two different texts: one labeled as peer-written and the other as AI-generated. The results revealed that while learners invested less time in revising a text labeled as AI-generated, information about the author did not affect the number of areas identified as requiring improvement or the number of revisions made. Moreover, learners who indicated greater prior exposure to media reports about AI-based text generators, a higher level of trust in AI, and a tendency toward ‘loafing’ in AI-assisted writing spent less time revising a text labeled as AI-generated. Conversely, learners with more experience in academic writing identified more areas for improvement and made more extensive revisions, regardless of the labeled authorship.
The full article can be found here: Radtke, A. & Rummel, N. (2025). Generative AI in academic writing: Does information on authorship impact learners’ revision behavior? Computers and Education: Artificial Intelligence, 8, Article 100350. https://doi.org/10.1016/j.caeai.2024.100350