About | HeinOnline Law Journal Library | HeinOnline Law Journal Library | HeinOnline

10 Oslo L. Rev. 1 (2023-2024)

handle is hein.journals/oslo10 and id is 1 raw text is: Oslo     Law    Review               j  Universitetsforlaget
Volume 10, No.1-2023, p.1-23
ISSN online: 2387-3299
SCIENTIFIC  PUBLICATION     DOI: https://do.org/10.18261/olr.10.1.1
Doctor Chatbot: The EU's Regulatory
Prescription for Generative Medical Al
Mathias Karlsen Hauglid
Doctoral Research Fellow, Faculty of Law, UiT the Arctic University of Norway
Norwegian Centre for Clinical Artificial Intelligence, University Hospital of Northern Norway
mathias.khauQlid@uit.no
Tobias Mahler
Professor, Norwegian Research Center for Computers and Law, University of Oslo
tobias.mahler@ ¾us.uioano
Abstract
This article analyses the EU's regulation of medical artificial intelligence (Al) from a product safety perspective, con-
centrating on the interplay between the proposed Al Act (AIA) and the Medical Device Regulation (MDR). Recent
advances in Al development illustrate the future potential of generative Al technologies, including those based on
Large Language Models (LLMs). In a medical context, Al systems with different degrees of generativity are conceiva-
ble. These Al systems can pose new types of risks that are specific to Al technologies, as well as more traditional risks
that are typical of medical devices. The proposed AIA is intended to address AI-specific risks foreseen by the EU legis-
lature, whereas the MDR addresses more traditional medical risks. Through two case studies which display different
degrees of generativity, this article identifies regulatory lacunae in the intersection between the AIA and the MDR. The
article suggests that the emerging regulatory framework for medical Al systems potentially leaves certain AI-specific
risks as well as certain typical medical device risks unregulated. Finally, the article discusses possible solutions that are
compatible with the intentions of the EU legislature pertaining to the regulation of medical Al systems.
Keywords
Al Act, medical devices, generative artificial intelligence, chatbots, large language models
1. Introduction
In recent years, the development and use of technologies involving artificial intelligence
(AI) has proliferated in the EU and internationally. In the health sector, the increased use of
AI raises several legal and policy issues.1 With this article, we contribute to the discussion
on the EU's regulation of medical AI from a product safety perspective. We focus on the
EU's emerging product safety framework as it will exist after the future introduction of the
1. For example, the World Health Organization (WHO) discusses various issues in a guidance document: see World
Health Organization, 'Ethics and governance of artificial intelligence for health: WHO guidance' (2021). Also, van
Kolfschooten outlines potential impacts on patient rights: see Hannah van Kolfschooten, 'EU Regulation of Arti-
ficial Intelligence: Challenges for Patients' Rights' (2022) 59(1) Common Market Law Review 81 <https://doi.org/
10.54648/cola2022005>.
Copyright © 2023 Author(s). This is an open access article distributed under the terms of the Creative Commons CC-BY 4.0
License (httns//creativecommonsorg/licensesbv/4.0).

What Is HeinOnline?

HeinOnline is a subscription-based resource containing thousands of academic and legal journals from inception; complete coverage of government documents such as U.S. Statutes at Large, U.S. Code, Federal Register, Code of Federal Regulations, U.S. Reports, and much more. Documents are image-based, fully searchable PDFs with the authority of print combined with the accessibility of a user-friendly and powerful database. For more information, request a quote or trial for your organization below.



Short-term subscription options include 24 hours, 48 hours, or 1 week to HeinOnline.

Contact us for annual subscription options:

Already a HeinOnline Subscriber?

profiles profiles most