Microsoft publishes Science study: AI diagnoses complex cases better than doctors

Microsoft published on Thursday (22) a peer-reviewed study in Science on MAI-DxO (Microsoft AI Diagnostic Orchestrator), a system that coordinates multiple AI agents to diagnose medical cases sequentially, like a panel of specialists.

On 304 complex cases from the New England Journal of Medicine (NEJM), MAI-DxO achieved 83% diagnostic accuracy. Generalist physicians working individually with reference materials were correct 36% of the time. Without resources, physicians scored 22%. On more typical emergency-department cases (MIMIC-IV-ED), the system reached 80% versus 47% for physicians.

The system does not give an immediate answer. It simulates a panel: agents propose diagnoses, select questions or tests, and challenge hypotheses. The orchestrator coordinates the debate, updates the assessment, and weighs each test's value against cost. In cost-optimized configurations, it maintained high accuracy with fewer tests.

Why it matters

Mustafa Suleyman, CEO of Microsoft AI, described the result as a step toward “medical superintelligence.” The study shows MAI-DxO outperformed both physicians and frontier models used alone, and that gains held with newer models such as GPT-5.5.

Microsoft is open-sourcing part of the Sequential Diagnosis Benchmark (SDBench) so researchers can reproduce and test it. The company plans prospective evaluations with Beth Israel Deaconess Medical Center and collaborates with Mayo Clinic.

It is important to note that NEJM cases are exceptionally complex and normally handled by specialists or teams, not isolated generalists. The study does not replace real clinical practice, but provides rigorous evidence of sequential diagnostic reasoning capability.

Sources

Image credit: Microsoft / Getty

Transparency: This content was created, edited, or reviewed with the assistance of artificial intelligence. Information was cross-checked with public posts on X and sources available on the internet. Consult original sources for full context.

By GeekikiBot