About | HeinOnline Law Journal Library | HeinOnline Law Journal Library | HeinOnline
LOG IN
LOG IN

71 J. Legal Educ. 387 (2021-2022)
ChatGPT Goes to Law School

handle is hein.journals/jled71 and id is 391 raw text is: 387 ChatGPT Goes to Law School Jonathan H. Choi Kristin E. Hickman Amy B. Monahan Daniel Schwarcz How well can AI models write law school exams without human assistance? To find out, we used the widely publicized AI model ChatGPT to generate answers to the final exams for four classes at the University of Minnesota Law School. We then blindly graded these exams as part of our regular grading processes for each class. Over ninety-five multiple-choice questions and twelve essay questions, ChatGPT performed on average at the level of a C+ student, achieving a low but passing grade in all four courses. After detailing these results, we discuss their implications for legal education and lawyering. We also provide example prompts and advice on how ChatGPT can assist with legal writing. I. What Is ChatGPT? ChatGPT is an AI language model produced by OpenAI and released in late 2o22.' GPT models, including ChatGPT, are autoregressive, meaning that they predict the next word given a body of text. For example, given the phrase I walked to the, a GPT model might predict that the next word is park with five percent probability, store with four percent probability, etc. The model can then repeatedly predict subsequent words (for example, and) to compose indefinitely long bodies of text. Jonathan H. Choi, Lead author, McKnight Land-Grant Professor, Associate Professor of Law, and Solly Robbins Faculty Research Scholar, University of Minnesota Law School. Kristin E. Hickman, McKnight Presidential Professor in Law, Distinguished McKnight University Professor, and Harlan Albert Rogers Professor in Law, University of Minnesota Law School. Amy B. Monahan, Distinguished McKnight University Professor and Melvin C. Steen Professor of Law, University of Minnesota Law School. Daniel Schwarcz, Fredrikson & Byron Professor of Law, University of Minnesota Law School. 1 Introducing ChatGPT, OPENAI (Nov 30, 2oQ2), https://openai.com/blog/chatgpt [hereinafter OPENAI]. Journal of Legal Education, Volume 71, Number 3 (Spring 2022)

What Is HeinOnline?

HeinOnline is a subscription-based resource containing thousands of academic and legal journals from inception; complete coverage of government documents such as U.S. Statutes at Large, U.S. Code, Federal Register, Code of Federal Regulations, U.S. Reports, and much more. Documents are image-based, fully searchable PDFs with the authority of print combined with the accessibility of a user-friendly and powerful database. For more information, request a quote or trial for your organization below.



Short-term subscription options include 24 hours, 48 hours, or 1 week to HeinOnline.

Purchase Access

Contact us for annual subscription options:

Contact Us

Already a HeinOnline Subscriber?

Log In

profiles profiles most