Abstract: Effective human-AI collaboration is contingent upon calibrated trust, wherein users depend on AI systems when accuracy is probable and rely on human judgment when errors are likely. In this study, a confidence-based mechanism for trust calibration within human-AI teams is examined. A decision-making strategy is proposed in which task delegation is governed by the AI’s confidence: when the confidence surpasses a specified threshold, the AI’s recommendation is adopted; otherwise, the decision is deferred to the human. Through simulation experiments on a binary classification task, performance outcomes are compared. The AI system achieves an accuracy of 77.7%, whereas the human decision-maker, modeled with a confidence-sensitive accuracy function ph(c) = 0.95 − 0.3c, attains an overall accuracy of 71.9%. Team performance is evaluated across a range of AI confidence thresholds (0.50 to 0.99), revealing that an intermediate threshold yields optimal team accuracy of 84.14%, substantially exceeding the performance of either agent individually. The findings provide a detailed analysis of confidence-based delegation, align with existing research on trust calibration, and underscore critical design implications for the development of human-centric AI systems.

Michael Ibrahim. “Confidence-Based Trust Calibration in Human-AI Teams”. International Journal of Advanced Computer Science and Applications (IJACSA) 16.12 (2025). http://dx.doi.org/10.14569/IJACSA.2025.01612122

@article{Ibrahim2025,
title = {Confidence-Based Trust Calibration in Human-AI Teams},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2025.01612122},
url = {http://dx.doi.org/10.14569/IJACSA.2025.01612122},
year = {2025},
publisher = {The Science and Information Organization},
volume = {16},
number = {12},
author = {Michael Ibrahim}
}