This article examines the potential implications of the implementation of artificial intelligence in health care for both its delivery and the medical profession. To this end, the first section explores the basic features of AI and the yet theoretical concept of autonomous AI followed by an overview of current and developing AI applications. Against this background, the second section discusses the transforming roles of physicians and changes in the patient–physician relationship that could be a consequence of gradual expansion of AI (...) in health care. Subsequently, an examination of the responsibilities physicians should assume in this process is explored. The third section describes conceivable practical and ethical challenges that implementation of a single all-encompassing AI healthcare system would pose. The fourth section presents arguments for regulation of AI in health care to ensure that these applications do not violate basic ethical principles and that human control of AI will be preserved in the future. In the final section, fundamental components of a moral framework from which such regulation may be derived are brought forward, and some possible strategies for building a moral framework are discussed. (shrink)