About | HeinOnline Law Journal Library | HeinOnline Law Journal Library | HeinOnline

109 Minn. L. Rev. 147 (2024-2025)
Lawyering in the Age of Artificial Intelligence

handle is hein.journals/mnlr109 and id is 147 raw text is: 













Article


Lawyering in the Age of Artificial
Intelligence


Jonathan H. Choi,t Amy B. Monahan,tt
and   Daniel   Schwarczttt

     We conducted  the first randomized controlled trial to study
the effect of AI assistance on human legal analysis. We randomly
assigned  law school students to complete realistic legal tasks ei-
ther with or without the assistance of GPT-4, tracking how long
the students took on each task and blind-grading the results.
     We found  that access to GPT-4 only slightly and inconsist-
ently improved  the quality of participants' legal analysis but in-
duced  large and consistent increases in speed. AI assistance im-
proved the quality of output unevenly where  it was useful at all,
the lowest-skilled participants saw the largest improvements. On
the other hand,  AI  assistance saved participants  roughly the
same  amount  of time regardless of their baseline speed. In follow-
up  surveys, participants reported  increased satisfaction from



    t  Professor of Law, University of Southern California Gould School of
Law.
    tt Distinguished McKnight University Professor and Melvin C. Steen Pro-
fessor, University of Minnesota Law School.
    ttt Fredrikson & Byron Professor of Law, University of Minnesota Law
School. For their feedback, we thank David Abrams, Ben Alarie, Paul Connell,
Kristin Hickman, David Hoffman, Michael Morse, Anthony Niblett, Jed Stiglitz,
Eric Talley, and the participants at the Mitchell Hamline Faculty Workshop,
the University of Pennsylvania Law and Economics Seminar, the Southern
Methodist University Conference on ChatGPT, the University of Toronto Law
School Faculty Workshop, the Harvard Law School Legal Profession Seminar,
and the Duke Law School Faculty Workshop. This research was supported by
the Kommerstad Faculty Imagination Fund at the University of Minnesota Law
School. Copyright © 2024 by Jonathan H. Choi, Amy B. Monahan, and Daniel
Schwarez.


147

What Is HeinOnline?

HeinOnline is a subscription-based resource containing thousands of academic and legal journals from inception; complete coverage of government documents such as U.S. Statutes at Large, U.S. Code, Federal Register, Code of Federal Regulations, U.S. Reports, and much more. Documents are image-based, fully searchable PDFs with the authority of print combined with the accessibility of a user-friendly and powerful database. For more information, request a quote or trial for your organization below.



Short-term subscription options include 24 hours, 48 hours, or 1 week to HeinOnline.

Contact us for annual subscription options:

Already a HeinOnline Subscriber?

profiles profiles most