MediHive: A Decentralized Agent Collective for Medical Reasoning

View PDF HTML (experimental)

Abstract:Large language models (LLMs) have revolutionized medical reasoning tasks, yet single-agent systems often falter on complex, interdisciplinary problems requiring robust handling of uncertainty and conflicting evidence. Multi-agent systems (MAS) leveraging LLMs enable collaborative intelligence, but prevailing centralized architectures suffer from scalability bottlenecks, single points of failure, and role confusion in resource-constrained environments. Decentralized MAS (D-MAS) promise enhanced autonomy and resilience via peer-to-peer interactions, but their application to high-stakes healthcare domains remains underexplored. We introduce MediHive, a novel decentralized multi-agent framework for medical question answering that integrates a shared memory pool with iterative fusion mechanisms. MediHive deploys LLM-based agents that autonomously self-assign specialized roles, conduct initial analyses, detect divergences through conditional evidence-based debates, and locally fuse peer insights over multiple rounds to achieve consensus. Empirically, MediHive outperforms single-LLM and centralized baselines on MedQA and PubMedQA datasets, attaining accuracies of 84.3% and 78.4%, respectively. Our work advances scalable, fault-tolerant D-MAS for medical AI, addressing key limitations of centralized designs while demonstrating superior performance in reasoning-intensive tasks.

Comments: Accepted to the 14th IEEE International Conference on Healthcare Informatics (IEEE ICHI 2026)

Subjects:

Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)

Cite as: arXiv:2603.27150 [cs.AI]

(or arXiv:2603.27150v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2603.27150

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Xiaoyang Wang [view email] [v1] Sat, 28 Mar 2026 05:57:58 UTC (1,370 KB)