RESIDENT: The Future of AI Assistants: Evaluating the Performance of GPT-4 and GPT-3.5 on Residency-level Psychiatry Questions | Prof. Abhinav Pillai

2024 APA Scientific Conference

50% of survey complete.

Please click "Next" if you did not attend this session

Question Title

* The session met the stated learning objectives:

	Strongly disagree	Disagree	Somewhat disagree	Neither agree or disagree	Somewhat agree	Agree	Strongly agree
Understanding the current capabilities and limitations of LLMs in answering psychiatric medical questions.	Understanding the current capabilities and limitations of LLMs in answering psychiatric medical questions. Strongly disagree	Understanding the current capabilities and limitations of LLMs in answering psychiatric medical questions. Disagree	Understanding the current capabilities and limitations of LLMs in answering psychiatric medical questions. Somewhat disagree	Understanding the current capabilities and limitations of LLMs in answering psychiatric medical questions. Neither agree or disagree	Understanding the current capabilities and limitations of LLMs in answering psychiatric medical questions. Somewhat agree	Understanding the current capabilities and limitations of LLMs in answering psychiatric medical questions. Agree	Understanding the current capabilities and limitations of LLMs in answering psychiatric medical questions. Strongly agree
Exploring the ethical and regulatory considerations of using LLMs in psychiatric education and practice.	Exploring the ethical and regulatory considerations of using LLMs in psychiatric education and practice. Strongly disagree	Exploring the ethical and regulatory considerations of using LLMs in psychiatric education and practice. Disagree	Exploring the ethical and regulatory considerations of using LLMs in psychiatric education and practice. Somewhat disagree	Exploring the ethical and regulatory considerations of using LLMs in psychiatric education and practice. Neither agree or disagree	Exploring the ethical and regulatory considerations of using LLMs in psychiatric education and practice. Somewhat agree	Exploring the ethical and regulatory considerations of using LLMs in psychiatric education and practice. Agree	Exploring the ethical and regulatory considerations of using LLMs in psychiatric education and practice. Strongly agree
Exploring future directions for LLMs and other AI in psychiatry.	Exploring future directions for LLMs and other AI in psychiatry. Strongly disagree	Exploring future directions for LLMs and other AI in psychiatry. Disagree	Exploring future directions for LLMs and other AI in psychiatry. Somewhat disagree	Exploring future directions for LLMs and other AI in psychiatry. Neither agree or disagree	Exploring future directions for LLMs and other AI in psychiatry. Somewhat agree	Exploring future directions for LLMs and other AI in psychiatry. Agree	Exploring future directions for LLMs and other AI in psychiatry. Strongly agree

Question Title

* Please rate the following on a scale of 1 to 5
(1 - strongly disagree and 5 - strongly agree):

	Strongly disagree	Disagree	Somewhat disagree	Neither agree or disagree	Somewhat agree	Agree	Strongly agree
The session was educationally relevant.	The session was educationally relevant. Strongly disagree	The session was educationally relevant. Disagree	The session was educationally relevant. Somewhat disagree	The session was educationally relevant. Neither agree or disagree	The session was educationally relevant. Somewhat agree	The session was educationally relevant. Agree	The session was educationally relevant. Strongly agree
The presenter was educationally effective.	The presenter was educationally effective. Strongly disagree	The presenter was educationally effective. Disagree	The presenter was educationally effective. Somewhat disagree	The presenter was educationally effective. Neither agree or disagree	The presenter was educationally effective. Somewhat agree	The presenter was educationally effective. Agree	The presenter was educationally effective. Strongly agree
The session provided interactive opportunities.	The session provided interactive opportunities. Strongly disagree	The session provided interactive opportunities. Disagree	The session provided interactive opportunities. Somewhat disagree	The session provided interactive opportunities. Neither agree or disagree	The session provided interactive opportunities. Somewhat agree	The session provided interactive opportunities. Agree	The session provided interactive opportunities. Strongly agree
The session provided opportunities to identify and/or reflect on what was learned and its potential impact on my practice	The session provided opportunities to identify and/or reflect on what was learned and its potential impact on my practice Strongly disagree	The session provided opportunities to identify and/or reflect on what was learned and its potential impact on my practice Disagree	The session provided opportunities to identify and/or reflect on what was learned and its potential impact on my practice Somewhat disagree	The session provided opportunities to identify and/or reflect on what was learned and its potential impact on my practice Neither agree or disagree	The session provided opportunities to identify and/or reflect on what was learned and its potential impact on my practice Somewhat agree	The session provided opportunities to identify and/or reflect on what was learned and its potential impact on my practice Agree	The session provided opportunities to identify and/or reflect on what was learned and its potential impact on my practice Strongly agree

Comments:

Question Title

* Please rate the following on a scale of 1 to 5
(1 - strongly disagree and 5 - strongly agree):

	Strongly disagree	Disagree	Somewhat disagree	Neither agree or disagree	Somewhat agree	Agree	Strongly agree
The session and presenter did NOT have commercial or other inappropriate bias.	The session and presenter did NOT have commercial or other inappropriate bias. Strongly disagree	The session and presenter did NOT have commercial or other inappropriate bias. Disagree	The session and presenter did NOT have commercial or other inappropriate bias. Somewhat disagree	The session and presenter did NOT have commercial or other inappropriate bias. Neither agree or disagree	The session and presenter did NOT have commercial or other inappropriate bias. Somewhat agree	The session and presenter did NOT have commercial or other inappropriate bias. Agree	The session and presenter did NOT have commercial or other inappropriate bias. Strongly agree

Comments:

Question Title

* Please provide any other comments you would like to share: