Should we be allowed to refuse any involvement of artificial intelligence technology in diagnosis and treatment planning? This is the relevant question posed by Ploug and Holm in a recent article in Medicine, Health Care and Philosophy. In this article, I adhere to their conclusions, but not necessarily to the rationale that supports them. First, I argue that the idea that we should recognize this right on the basis of a rational interest defence is not plausible, unless we are willing to judge each patient’s ideology or religion. Instead, I consider that the right must be recognized by virtue of values such as social pluralism or individual autonomy. Second, I point out that the scope of such a right should be limited at least under three circumstances: if it is against a physician’s obligation to not cause unnecessary harm to a patient or to not provide futile treatment, in cases where the costs of implementing this right are too high, or if recognizing the right would deprive other patients of their own rights to adequate health care.