Student and GPT Responses\
contains the answers given by students and ChatGPT for each questions. There are 10 questions associated with each course, and for each question, there are three answers provided by students and three answers provided by ChatGPT. File name indicates whether the content therein are given by students or ChatGPT.
QuillBot Responses\
contains the paraphrased version of ChatGPT answers, organized in the same way as in Archive\
. File names contain the index of the answer (1, 2, or 3), the mode of paraphrasing (creative, expand, formal, etc.), and the strength of paraphrasing. For our experiments, all strength are set to the highest strength level, 3.
Grades_and_Taxonomy.csv
contains the grades received by each of the student and GPT responses from all three graders, as well as where the question falls on the Anderson and Krathwohl taxonomy.
@article{ibrahim2023perception,
title = {Perception, performance, and detectability of conversational artificial intelligence across 32 university courses},
author = {Hazem Ibrahim, Fengyuan Liu, Rohail Asim, Balaraju Battu, Sidahmed Benabderrahmane, Bashar Alhafni, Wifag Adnan, Tuka Alhanai, Bedoor AlShebli, Riyadh Baghdadi, Jocelyn J. Bélanger, Elena Beretta, Kemal Celik, Moumena Chaqfeh, Mohammed F. Daqaq, Zaynab El Bernoussi, Daryl Fougnie, Borja Garcia de Soto, Alberto Gandolfi, Andras Gyorgy, Nizar Habash, J. Andrew Harris, Aaron Kaufman, Lefteris Kirousis, Korhan Kocak, Kangsan Lee, Seungah S. Lee, Samreen Malik, Michail Maniatakos, David Melcher, Azzam Mourad, Minsu Park, Mahmoud Rasras, Alicja Reuben, Dania Zantout, Nancy W. Gleason, Kinga Makovi, Talal Rahwan and Yasir Zak},
journal = {Scientific Reports},
volume = {13},
number = {1},
pages = {12187},
year = {2023},
publisher = {Nature Publishing Group UK London}
}