None
EN
STAT+: Clinical chatbots are taking medicine by storm. Should doctors trust them?
['Katie Palmer', 'Katie Covers The Impact Of Health Technology On Patients', 'Clinicians', 'Businesses. Her Stories Explore The Price Tag Of Clinical Ai', 'Digital Health At The Fda', 'The Boom In Direct-To-Consumer Telehealth. Confidential Tips Can Be Sent On Signal At', 'Health Tech Correspondent', 'Adam Feuerstein', 'Jeffrey Millstein', 'Jennifer Karlin']
STAT
Her stories explore the price tag of clinical AI, digital health at the FDA, and the boom in direct-to-consumer telehealth.
Hundreds of thousands of U.S. doctors use clinical large language models, pitched by companies like OpenEvidence, Doximity, and UpToDate as an antidote to the dangers of hallucination-prone generalist models from Big Tech.
Researchers from NYU Langone Health had tested general and clinical models, including OpenEvidence and UpToDate Expert AI, on three sets of clinical questions.
The findings, published in Nature Medicine in June: The clinical AI performed worse than the general models.
“I’ve never seen a single paper trigger the kind of reactions this one has in the health AI community,” wrote Kaiser Permanente’s vice president of AI and emerging technologies on LinkedIn.