Generative AI Survey

Description And Consent

Who is conducting the study?
Co-supervisors: Michael DeBraga, Stuart Kamenetsky
Primary investigators: Andrew Boyce, Nabeel Elabbassi, Mayukha Pelluri, Jacqueline Vazquez, Sania Khurshid, Seflora Egatsi


Who will be analyzing the data?
The following co-supervisors and primary investigators will be analysing the data: Michael DeBraga, Stuart Kamenetsky, Andrew Boyce, Nabeel Elabbassi, Mayukha Pelluri, Jacqueline Vazquez, Sania Khurshid, Seflora Egatsi


Why are we doing this study?
1. To investigate the perceptions of AI in students.
2. To investigate the relationship between frequency of AI use and academic confidence in students.
3. To investigate the relationship between academic confidence and reported GPA scores.
4. To investigate the relationship between frequency of AI use and reported GPA score.


Anonymized data from this study may be published in academic research journals and may also be presented at scholarly conferences. Aggregate data and/or anonymized quotes may also be shared publicly.


What will happen in this study?
You will be asked to complete a 30 minute survey. Your participation is anonymous and voluntary.

Who can participate in this study?
Individuals who are 18 or older and currently registered as undergraduate students in an English speaking university are eligible to participate in this study.

Are there any risks in taking part in this study?
No significant risks exist for participants of this study. Possible minor psychological discomfort may arise from prompts that request students to reflect on prior educational experiences. Additionally, emotional discomfort may arise as students are asked to describe their personality using the Ten Item Personality Inventory - an instrument that examines the big five personality types. With that, it is important to note that responding to such prompts are entirely optional. Students may also withdraw from the study at any time should they wish to do so.


What are the benefits to you participating in this study?
Students who completed the survey are eligible to enter a raffle for a chance to obtain one of five $50 gift cards. Confidentiality Data will be securely stored on encrypted computers and shared between the researchers using a FIPPA and PIPEDA compliant (federal government mandated) tool. Instead of using names or any identifiable information (e.g. student numbers), numeric codes will be assigned to participants to protect their identity. The Primary Investigators will only have access to the anonymized data. The information gathered from the surveys will be stored for 5 years at the University of Toronto - Mississauga on a secure and encrypted ISUP data storage system. To enter the raffle, students will be asked to input their University of Toronto email into a separate survey.
Survey data will not be correlated.


Who can you contact if you have questions about the study?
If you have any concerns or complaints about your rights as a research participant and/or your experiences while participating in this study, contact Professor Michael DeBraga or Professor Stuart Kamenetsky at m.debraga@utoronto.ca or stuart.kamenetsky@utoronto.ca respectively.


Consent
Your participation in this study is entirely voluntary and you may refuse to participate or withdraw from the study at any time. By completing this survey you consent to participate in this study and having your responses included in the analyses.
Section 1: Demographic Establishment
1.Please state your undergraduate year of study.
2.Please state your program of study.
3.Please input the 3 letter course codes of the courses that you are currently enrolled in (e.g., PSY, BIO, SOC). Please input "I prefer not to answer" if you do not wish to respond.
4.Please indicate the range in which your current GPA score lies:
Section 2: Personality Traits
Scale:
1 = Disagree strongly
2 = Disagree moderately
3 = Disagree a little
4 = Neither agree nor disagree
5 = Agree a little
6 = Agree moderately
7 = Agree strongly
I prefer not to answer
I see myself as:
5.Extraverted, enthusiastic.
6.Critical, quarrelsome.
7.Dependable, self-disciplined.
8.Anxious, easily upset.
9.Open to new experiences, complex.
10.Reserved, quiet.
11.Sympathetic, warm.
12.Disorganized, careless.
13.Calm, emotionally stable.
14.Conventional, uncreative.
Section 3: Frequency of AI Utilization
(Response options for all questions: Always, Often, Sometimes, Rarely, Never, I prefer not to answer)
Definitions:
Always = 6+ times per week
Often = 4–5 times per week
Sometimes = 1–3 times per week
Rarely = 1–2 times per month
Never = no use of generative AI
15.I incorporate generative AI into my daily study routine.
Always
Often
Sometimes
Rarely
Never
I prefer not to answer
16.I use generative AI to research academic topics.
Always
Often
Sometimes
Rarely
Never
I prefer not to answer
17.I use generative AI to clarify difficult concepts.
Always
Often
Sometimes
Rarely
Never
I prefer not to answer
18.I rely on generative AI for study assistance during exams.
Always
Often
Sometimes
Rarely
Never
I prefer not to answer
19.As part of my studies, I use AI for text analysis, text processing, and text creation.
Always
Often
Sometimes
Rarely
Never
I prefer not to answer
20.I use generative AI as a primary resource for academic queries.
Always
Often
Sometimes
Rarely
Never
I prefer not to answer
21.As part of my studies, I use AI to have subject-specific concepts explained to me.
Always
Often
Sometimes
Rarely
Never
I prefer not to answer
22.As part of my studies, I use AI for problem solving and decision making.
Always
Often
Sometimes
Rarely
Never
I prefer not to answer
Section 4: AI Attitude
(Response scale for all: 1 = Strongly Disagree … 7 = Strongly Agree, plus I prefer not to answer)
23.Generative AI is reliable.
1, Strongly disagree
2, Disagree
3, Disagree a little
4, Neither agree nor disagree
5, Agree a little
6, Moderately agree
7, Strongly agree
I prefer not to answer
24.Generative AI harbors risks when using personal data.
1, Strongly disagree
2, Disagree
3, Disagree a little
4, Neither agree nor disagree
5, Agree a little
6, Moderately agree
7, Strongly agree
I prefer not to answer
25.Generative AI reproduces stereotypes and prejudices.
1, Strongly disagree
2, Disagree
3, Disagree a little
4, Neither agree nor disagree
5, Agree a little
6, Moderately agree
7, Strongly agree
I prefer not to answer
26.The use of generative AI leads to problems with copyrights.
1, Strongly disagree
2, Disagree
3, Disagree a little
4, Neither agree nor disagree
5, Agree a little
6, Moderately agree
7, Strongly agree
I prefer not to answer
27.Chatbots such as ChatGPT are amongst the most important inventions of the 21st century.
1, Strongly disagree
2, Disagree
3, Disagree a little
4, Neither agree nor disagree
5, Agree a little
6, Moderately agree
7, Strongly agree
I prefer not to answer
28.Generative AI is not transparent with regard to the underlying text basis.
1, Strongly disagree
2, Disagree
3, Disagree a little
4, Neither agree nor disagree
5, Agree a little
6, Moderately agree
7, Strongly agree
I prefer not to answer
29.Generative AI contributes to the spreading of misinformation.
1, Strongly disagree
2, Disagree
3, Disagree a little
4, Neither agree nor disagree
5, Agree a little
6, Moderately agree
7, Strongly agree
I prefer not to answer
Section 5: Academic Confidence
(Response scale: Not at all confident → Very confident, plus I prefer not to answer)
How confident are you that you will be able to:
30.Study effectively on your own in independent/private study.
Not confident at all
Extremely confident
I prefer not to answer
31.Produce your best work under examination conditions:
Not confident at all
Extremely confident
I prefer not to answer
32.Attain good grades in your work.
Not confident at all
Extremely confident
I prefer not to answer
33.Engage in profitable academic debate with your peers.
Not confident at all
Extremely confident
I prefer not to answer
34.Manage your work load to meet coursework deadlines.
Not confident at all
Extremely confident
I prefer not to answer
35.Make the most of the opportunity of studying for a degree at university.
Not confident at all
Extremely confident
I prefer not to answer
36.Understand the material outlined and discussed with you by lecturers.
Not confident at all
Extremely confident
I prefer not to answer
To enter the raffle, please visit this link: Raffle Entry Form