As hospitals deploy more AI tools for clinical decision support and documentation, the industry must prepare for a subtler risk: clinicians and patients placing too much confidence in AI simply because it sounds authoritative, according to Dr. David Kirk, chief medical officer at Regard.
Beyond hallucinations to a deeper problem
“We have been so focused on AI getting facts wrong that we missed the bigger problem: AI helping people fake expertise,” Kirk said. He coined the term “cognitive spoofing” to describe AI’s ability to project expertise without possessing the experience, judgment and contextual understanding clinicians develop over years of practice.
Patients bring AI into the exam room
Patients increasingly arrive with AI-generated diagnoses and treatment suggestions from consumer AI tools, creating both opportunities and challenges for clinicians. Kirk argues organizations should foster cultures where senior physicians openly question AI recommendations, demonstrating that thoughtful skepticism is part of safe clinical practice.
The implications extend beyond individual patient encounters. AI-generated assessments in medical education can hide uncertainty and knowledge gaps, making it harder for attending physicians to identify where trainees need additional instruction.