An OpenAI Reasoning Model Outperformed Doctors at Diagnosis in a Real-World Harvard Study
A study published April 30 in Science by Harvard and Beth Israel Deaconess researchers found an OpenAI reasoning model matched and often outperformed doctors at diagnosing patients and making decisions about managing their care.
Artificial IntelligenceGNGV Editorial Team5 min read
On April 30, 2026, the journal Science published a study by researchers at Harvard Medical School and Beth Israel Deaconess Medical Center evaluating how a reasoning model developed by OpenAI performs on real emergency-room cases. NPR and STAT covered the result the same day: in a head-to-head test using only the electronic health records available at the time of care, the AI model matched or exceeded experienced physicians on diagnosis, recommended tests and case-management decisions.
The model was particularly strong at rare diseases and complex multi-system cases — exactly the situations where human cognitive bias tends to fail. It also outperformed GPT-4, the previous AI baseline.
The authors are explicit that this does not mean AI should replace doctors. The study evaluated reasoning quality, not patient outcomes; physicians make decisions in noisy, time-pressured environments that text-based benchmarks do not fully capture. They argue the right next step is controlled trials embedded in real clinical workflows, where AI assists clinicians on hard cases while staying under human oversight.
The result lands inside a wider debate about the role of AI in medicine. STAT and Science have called for new regulatory frameworks, and a separate WHO/Europe report covering all 27 EU member states found 74% already deploying AI in diagnostics. The promise — clinicians supported by tireless reasoning copilots that catch what tired humans miss — is starting to look credible. The hard work is integrating it ethically and equitably.
