Nature

Assessing ChatGPT 4.0’s test performance and clinical diagnostic accuracy on USMLE STEP 2 CK and clinical case reports

While there is data assessing the test performance of artificial intelligence (AI) chatbots, including the Generative Pre-trained Transformer 4.0 (GPT 4) chatbot (ChatGPT 4.0), there is scarce data on ...
Nature

Multidisciplinary blinded randomized expert evaluation of large language models for clinical diagnosis and management

Direct clinical uses of large language models (LLMs) remain controversial, partly because of the lack of methodological rigor in assessing their risks and benefits in medicine. We developed Medieval, ...
MobiHealthNews

GPT-4 outperformed 99.98% of simulated human readers in diagnosing complex clinical cases

OpenAI's GPT-4 correctly diagnosed 52.7% of complex challenge cases, compared to 36% of medical journal readers, and outperformed 99.98% of simulated human readers, according to a study published by ...
Medical Xpress

AI remains lacking in clinical reasoning abilities, according to study of 21 large language models

Despite increasing use of artificial intelligence (AI) in health care, a new study led by Mass General Brigham researchers from the MESH Incubator shows that generative AI models continue to fall ...