Skip to main content

A DYNAMIC TRUST-AWARE EXPLAINABILITY MODEL FOR ARTIFICIAL INTELLIGENCE SYSTEMS OPERATING IN HIGH-CON

Page 1

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

A DYNAMIC TRUST-AWARE EXPLAINABILITY MODEL FOR ARTIFICIAL INTELLIGENCE SYSTEMS OPERATING IN HIGH-CONSEQUENCE DECISION DOMAINS Sapna Singh1, Mrs. Arifa Khan2 1Master of Technology, Computer Science and Engineering, Lucknow Institute of Technology, Lucknow, India 2Assistant Professor, Department of Computer Science and Engineering, Lucknow Institute of Technology,

Lucknow, India ---------------------------------------------------------------------***---------------------------------------------------------------------

Abstract - Artificial Intelligence (AI) systems are

treatment planning, and patient outcome prediction, where incorrect decisions can lead to severe or even fatal consequences. Similarly, autonomous vehicles rely on AI algorithms for real-time perception, navigation, and control, requiring precise and reliable decision-making to ensure passenger safety. In defense applications, AI is employed for threat detection, surveillance, and mission-critical decisionmaking, where errors can have significant strategic and human implications (Russell and Norvig, 2021). These domains highlight the growing dependence on AI systems for critical operations where accuracy and robustness are paramount.

increasingly deployed in high-consequence decision domains such as healthcare, autonomous vehicles, and defense, where reliability, transparency, and accountability are critical. However, most existing AI models operate as black boxes and rely on static trust assessments, limiting their adoption in safety-critical environments. This paper proposes a novel Dynamic Trust-Aware Explainability Model that integrates real-time trust evaluation with explainable AI (XAI) techniques to enhance decision reliability and stakeholder confidence. The proposed framework consists of three core components: an AI decision engine, a dynamic trust module, and an explainability module, connected through a continuous feedback loop. Trust is quantified dynamically using performance metrics, uncertainty estimation, and human feedback, while interpretability is achieved through modelagnostic techniques such as SHAP and LIME. The model is evaluated using simulation-based experiments across multiple high-consequence domains under varying conditions, including noisy data and high-risk scenarios. Experimental results demonstrate that the proposed approach achieves improved predictive performance (approximately 91% accuracy), enhanced trust stability, and more interpretable decision outputs compared to baseline models. The integration of dynamic trust with explainability provides a robust framework for developing transparent, reliable, and humancentric AI systems suitable for critical decision-making applications.

1.1.2 Need for Reliability, Transparency, and Accountability Despite the remarkable performance of AI models, particularly deep learning systems, their deployment in high-risk environments necessitates strict requirements for reliability, transparency, and accountability. Reliability ensures consistent performance under varying conditions, while transparency enables stakeholders to understand how decisions are made. Accountability is equally essential, as AIdriven decisions must be auditable and justifiable in regulatory and ethical contexts. The lack of interpretability in complex models often leads to reduced user trust and hesitancy in adoption. Explainable AI (XAI) has emerged as a solution to address these concerns by providing interpretable insights into model behavior, thereby bridging the gap between automated decision-making and human understanding (Doshi-Velez and Kim, 2017).

Key Words: Explainable Artificial Intelligence (XAI) , Dynamic Trust Modeling, Trust-Aware AI Systems , HighConsequence Decision Domains , Human-Centric AI , AI Reliability and Transparency

1.2 Problem Statement

1. INTRODUCTION

1.2.1 Black-Box Nature of AI

1.1 Background

A major limitation of modern AI systems, particularly deep neural networks, is their black-box nature, where the internal decision-making process remains opaque to users. Although these models achieve high predictive accuracy, they provide little to no explanation for their outputs, making it difficult for stakeholders to validate or trust the results. This lack of interpretability is especially problematic in high-consequence domains, where understanding the

1.1.1 AI in High-Consequence Decision Domains Artificial Intelligence (AI) has rapidly evolved into a transformative technology across multiple high-consequence decision domains, including healthcare, autonomous vehicles, and defense systems. In healthcare, AI-driven decision support systems assist clinicians in diagnosis,

© 2026, IRJET

|

Impact Factor value: 8.226

|

ISO 9001:2008 Certified Journal

|

Page 2006


Turn static files into dynamic content formats.

Create a flipbook