Concerning Uncertainty -- A Systematic Survey of Uncertainty-Aware XAI

View PDF HTML (experimental)

Abstract:This paper surveys uncertainty-aware explainable artificial intelligence (UAXAI), examining how uncertainty is incorporated into explanatory pipelines and how such methods are evaluated. Across the literature, three recurring approaches to uncertainty quantification emerge (Bayesian, Monte Carlo, and Conformal methods), alongside distinct strategies for integrating uncertainty into explanations: assessing trustworthiness, constraining models or explanations, and explicitly communicating uncertainty. Evaluation practices remain fragmented and largely model centered, with limited attention to users and inconsistent reporting of reliability properties (e.g., calibration, coverage, explanation stability). Recent work leans towards calibration, distribution free techniques and recognizes explainer variability as a central concern. We argue that progress in UAXAI requires unified evaluation principles that link uncertainty propagation, robustness, and human decision-making, and highlight counterfactual and calibration approaches as promising avenues for aligning interpretability with reliability.

Comments: 21 pages, 2 figures, journal

Subjects:

Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

ACM classes: A.1

Cite as: arXiv:2603.26838 [cs.AI]

(or arXiv:2603.26838v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2603.26838

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Helena Löfström HeLo [view email] [v1] Fri, 27 Mar 2026 08:07:18 UTC (472 KB)