IBL News | New York
Signaling the risk of widespread cheating, ChatGPT passed a high–profile exam at a U.S. law school – Minnesota University Law School – after writing essays on topics, ranging from constitutional law to taxation and torts.
The bot scored a C+ overall and displayed a strong grasp of basic legal rules, but often struggled to spot issues when given an open–ended prompt, a core skill on law school exams.
Despite its shortcomings, the achievement is remarkable, as it signals that AI–driven cheating could threaten traditional classroom teaching and assessment methods.
Jonathan Choi, a Minnesota University Law School professor, gave ChatGPT the same test faced by students, consisting of 95 multiple-choice questions and 12 essay questions.
“In writing essays, ChatGPT displayed a strong grasp of basic legal rules and had consistently solid organization and composition,” the authors wrote in a white paper titled “ChatGPT goes to law school” published Monday.
The bot was near the bottom of the class in most subjects and “bombed” at multiple-choice questions involving mathematics.
“ChatGPT often struggled to spot issues when given an open-ended prompt, a core skill on law school exams.”