DEVELOPMENT OF A HIERARCHICAL ATTENTION-GUIDED DEEP CONVOLUTIONAL NETWORK FOR CONTEXT-AWARE IMAGE UN

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

DEVELOPMENT OF A HIERARCHICAL ATTENTION-GUIDED DEEP CONVOLUTIONAL NETWORK FOR CONTEXT-AWARE IMAGE UNDERSTANDING WITH DYNAMIC FEATURE SUPPRESSION IN PYTHON Km. Mahima Verma1, Mrs. Arifa Khan2 1Master of Technology, Computer Science and Engineering, Lucknow Institute of Technology, Lucknow, India 2Assistant Professor, Department of Computer Science and Engineering, Lucknow Institute of Technology,

Lucknow, India ---------------------------------------------------------------------***--------------------------------------------------------------------1. INTRODUCTION

Abstract - Recent advancements in deep learning have

significantly enhanced the capabilities of computer vision systems; however, conventional Convolutional Neural Networks (CNNs) still face limitations in capturing complex contextual relationships and handling redundant feature representations. These challenges often lead to suboptimal performance in context-aware image understanding tasks. To address these issues, this paper proposes a novel Hierarchical Attention-Guided Deep Convolutional Network (HAG-DCN) integrated with a Dynamic Feature Suppression Mechanism (DFSM). The proposed architecture employs multi-level attention modules to capture both local and global contextual dependencies across different layers of the network.

Simultaneously, the DFSM selectively suppresses lowimportance and noisy feature activations, enabling the model to focus on the most informative visual patterns. The model is implemented using Python-based deep learning frameworks and evaluated on benchmark datasets including CIFAR-10, ImageNet, and COCO. Experimental results demonstrate that the proposed approach outperforms traditional CNN and single-level attention-based models in terms of accuracy, precision, recall, and F1-score. Furthermore, the integration of hierarchical attention and dynamic feature suppression reduces computational redundancy and enhances model efficiency. The findings indicate that the proposed framework significantly improves context-aware image understanding by effectively modeling semantic relationships and refining feature representations. This research contributes a robust and scalable solution for advanced computer vision applications such as autonomous systems, medical imaging, and intelligent surveillance.

1.1 Background 1.1.1 Evolution of Computer Vision Using Deep Learning Computer vision has undergone a significant transformation with the advent of deep learning, particularly through the use of deep convolutional neural networks (CNNs). Earlier approaches relied on handcrafted features such as SIFT and HOG, which often struggled to generalize across complex visual environments. The introduction of deep learning enabled automatic feature extraction from raw image data, allowing models to learn hierarchical representations ranging from low-level edges to high-level semantic concepts. Landmark developments such as deep CNN architectures and attention-based models have further improved performance in tasks like image classification, object detection, and segmentation. More recently, attention mechanisms and transformer-based architectures have demonstrated the ability to model long-range dependencies, marking a shift toward more context-aware visual understanding (Vaswani et al., 2017; LeCun et al., 2015).

1.1.2 Importance of Context-Aware Understanding in Real-World Systems In real-world scenarios, understanding visual data requires more than recognizing isolated objects; it demands the ability to interpret relationships between objects and their surrounding environment.

Context-aware image understanding enables systems to derive meaningful insights by considering spatial, semantic, and relational dependencies within an image. This capability is essential in applications such as autonomous driving, where recognizing interactions between vehicles, pedestrians, and road conditions is critical, and in medical imaging, where contextual patterns help identify abnormalities. By incorporating contextual awareness, deep learning models can achieve more accurate and reliable predictions, thereby enhancing decision-making processes in intelligent systems (Zhao et al., 2017).

Key Words: Hierarchical Attention, Context-Aware Image Understanding, Dynamic Feature Suppression, Deep Convolutional Neural Networks, Computer Vision, Deep Learning

© 2026, IRJET

|

Impact Factor value: 8.226

|

ISO 9001:2008 Certified Journal

|

Page 3690

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

1.2 Problem Statement

efficiency and reduce noise within deep feature maps, leading to better model generalization.

1.2.1 Weak Contextual Dependency Modeling in CNNs

1.3.3 Improvement of Contextual Understanding

Despite their success, conventional CNNs primarily focus on local feature extraction due to their limited receptive fields, which restricts their ability to capture long-range dependencies across different regions of an image. This limitation leads to incomplete scene understanding, particularly in complex environments where relationships between distant objects play a crucial role. Although deeper architectures partially address this issue, they still struggle to model global context effectively, necessitating the integration of advanced mechanisms such as attention modules (Wang et al., 2018).

The final objective is to enhance context-aware image understanding by combining hierarchical attention and dynamic feature suppression. This integrated approach aims to improve the model’s ability to interpret complex visual scenes by capturing both local details and global contextual relationships.

1.4 Contributions of the Paper 1.4.1 Multi-Level Hierarchical Attention Integration This paper introduces a novel hierarchical attention framework that operates across multiple layers of a deep convolutional network. Unlike conventional single-level attention mechanisms, the proposed approach captures contextual dependencies at different abstraction levels, enabling a more comprehensive understanding of visual data.

1.2.2 Redundant Feature Extraction in Deep Networks Another major limitation of deep CNNs is the generation of redundant or overlapping feature representations. As the network depth increases, multiple layers may learn similar or less informative features, resulting in inefficiencies in both computation and learning. This redundancy not only increases model complexity but can also degrade performance by introducing unnecessary noise into the feature space (Hu et al., 2018).

1.2.3 Lack Mechanisms

of

Adaptive

Feature

1.4.2 Dynamic Feature Suppression Layer (DFSL) A key contribution of this research is the development of a Dynamic Feature Suppression Layer (DFSL), which selectively suppresses low-importance feature activations during training. This adaptive mechanism reduces redundancy and enhances the quality of learned representations, improving both efficiency and interpretability.

Suppression

Most traditional CNN architectures treat all extracted features with equal importance, lacking mechanisms to dynamically suppress irrelevant or low-contributing features. In real-world images, background clutter and noise often lead to the extraction of non-informative features, which can negatively impact model accuracy. The absence of adaptive feature suppression prevents the model from focusing on the most discriminative regions, highlighting the need for dynamic feature filtering techniques (Woo et al., 2018).

1.4.3 Improved Efficiency and Accuracy By combining hierarchical attention with dynamic feature suppression, the proposed model achieves improved computational efficiency and higher prediction accuracy. The reduction of redundant features and enhanced focus on relevant information contribute to better performance across various evaluation metrics.

1.3 Research Objectives

1.4.4 Comparative Evaluation with Existing Models

1.3.1 Design of Hierarchical Attention-Based CNN

The proposed framework is extensively evaluated against traditional CNNs and existing attention-based models using benchmark datasets. The results demonstrate superior performance in terms of accuracy, precision, recall, and F1score, validating the effectiveness of the proposed approach in context-aware image understanding tasks.

The first objective of this research is to design a hierarchical attention-guided CNN architecture that can capture contextual dependencies at multiple levels of feature representation. By integrating attention modules across different layers, the model aims to enhance its ability to focus on relevant spatial and semantic information, thereby improving overall image understanding.

2. LITERATURE REVIEW 2.1 Deep Convolutional Neural Networks

1.3.2 Implementation of Dynamic Feature Suppression The second objective is to develop a dynamic feature suppression mechanism that can automatically identify and reduce the influence of redundant or irrelevant features.

This mechanism is intended to improve feature selection

© 2026, IRJET

|

Impact Factor value: 8.226

2.1.1 CNN Evolution and Limitations Deep Convolutional Neural Networks (CNNs) have been the cornerstone of modern computer vision, enabling significant improvements in tasks such as image classification, object detection, and segmentation. Early architectures

|

ISO 9001:2008 Certified Journal

|

Page 3691

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

demonstrated that hierarchical feature learning could replace handcrafted descriptors by automatically extracting low-level to high-level representations from images. Over time, deeper and more sophisticated CNN models improved accuracy and generalization. However, despite these advancements, CNNs inherently rely on local receptive fields, which limits their ability to capture long-range dependencies and global contextual relationships. Additionally, increasing network depth often leads to redundancy in learned features and higher computational cost, which can negatively affect efficiency and scalability (LeCun et al., 2015).

Incorporating contextual relationships enables models to achieve a more holistic understanding of images, improving both accuracy and robustness in complex environments (Zhao et al., 2017).

2.4 Feature Selection and Suppression Techniques 2.4.1 Redundancy Problem in Deep Networks Deep neural networks often generate a large number of feature maps, many of which may contain redundant or irrelevant information. This redundancy arises due to repeated feature extraction across layers and the absence of mechanisms to filter unnecessary information. As a result, models may suffer from increased computational complexity and reduced efficiency. Feature selection and suppression techniques aim to address this issue by identifying and retaining only the most informative features. Methods such as channel recalibration and attention-based filtering have shown effectiveness in improving feature quality and reducing noise, thereby enhancing overall model performance (Hu et al., 2018).

2.2 Attention Mechanisms in Vision 2.2.1 Spatial, Channel, and Self-Attention Attention mechanisms have emerged as a powerful solution to overcome the limitations of conventional CNNs by enabling models to focus selectively on important features.

Spatial attention identifies relevant regions within an image, while channel attention emphasizes informative feature maps across different channels. These mechanisms help refine feature representations by suppressing less useful information. Self-attention further extends this concept by modeling relationships between all elements in a feature map, allowing the network to capture both local and global dependencies effectively. Such mechanisms significantly enhance the representational power of deep learning models in complex visual tasks (Woo et al., 2018).

2.5 Research Gap Although attention mechanisms have been widely adopted in computer vision, most existing approaches apply attention at a single level of the network. This limits their ability to capture multi-scale and hierarchical contextual dependencies, which are essential for understanding complex visual scenes. There is a need for architectures that integrate attention mechanisms across multiple layers to enable comprehensive feature learning. Current deep learning models often lack dynamic mechanisms to suppress irrelevant or low-importance features during training.

Without adaptive feature suppression, networks may continue to process noisy or redundant information, reducing both efficiency and accuracy. This highlights the necessity for intelligent feature filtering strategies that can operate dynamically based on input data characteristics.

Despite progress in attention-based models, many existing systems still struggle to balance local feature extraction with global context understanding. CNNs excel at capturing local patterns, while attention-based models focus on global relationships, but few approaches effectively integrate both aspects. This gap indicates the need for a unified framework that combines hierarchical attention with adaptive feature suppression to achieve efficient and robust context-aware image understanding.

2.2.2 Influence of Transformer-Based Architectures The introduction of transformer-based architectures has revolutionized computer vision by demonstrating the effectiveness of self-attention in modeling global context.

Unlike CNNs, transformers process images as sequences of patches and compute relationships between all regions simultaneously. This approach enables better context modeling and long-range dependency learning. Vision Transformers and their variants have achieved state-of-theart performance in multiple vision tasks, highlighting the importance of attention-driven feature learning. However, these models often require large datasets and high computational resources, which limits their practical deployment in some applications (Dosovitskiy et al., 2021).

2.3 Context-Aware Image Understanding 2.3.1 Importance of Contextual Relationships Context-aware image understanding focuses on interpreting visual data by considering relationships between objects, regions, and the overall scene. In many real-world scenarios, the meaning of an object depends heavily on its surrounding context. For instance, identifying a pedestrian in a traffic scene requires understanding its relationship with roads, vehicles, and signals. Traditional models that focus solely on object-level features often fail to capture such dependencies, leading to incomplete or inaccurate predictions.

© 2026, IRJET

|

Impact Factor value: 8.226

3. PROPOSED METHODOLOGY 3.1 Overview of Proposed Framework 3.1.1 Pipeline Diagram Explanation The proposed methodology is structured as a unified deep learning pipeline designed to enhance context-aware image understanding through effective feature representation and

|

ISO 9001:2008 Certified Journal

|

Page 3692

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

refinement. The framework begins with input image acquisition followed by preprocessing steps such as normalization and augmentation. The processed images are then passed through convolutional layers for feature extraction. These features are subsequently refined using a hierarchical attention mechanism that operates across multiple levels of the network. Finally, a Dynamic Feature Suppression Mechanism (DFSM) is applied to filter out redundant or low-importance features before classification.

The pipeline ensures a systematic flow of information, where each stage contributes to improving the quality and relevance of learned representations.

abstraction. This multi-layer attention strategy enhances the model’s ability to distinguish important visual patterns across varying feature scales.

3.3.2 Capturing Global and Local Context By combining attention across multiple layers, the proposed mechanism captures both local and global contextual dependencies. Local attention focuses on fine details within small regions, while global attention captures relationships between distant regions in the image. This dual capability allows the model to understand complex visual scenes where object relationships and contextual cues are critical for accurate interpretation.

3.1.2 Integration of CNN, Attention, and DFSM

3.4 Dynamic Feature Suppression Mechanism (DFSM)

The core strength of the proposed framework lies in the seamless integration of Convolutional Neural Networks (CNNs), hierarchical attention modules, and the DFSM. CNNs serve as the backbone for extracting hierarchical visual features, while attention modules selectively emphasize contextually important regions. The DFSM further refines these features by suppressing noise and redundancy. This integrated design enables the model to capture both discriminative and contextual information efficiently, leading to improved performance in complex visual tasks.

3.4.1 Feature Importance Scoring

3.2 CNN-Based Feature Extraction

The DFSM introduces a mechanism for evaluating the importance of each feature channel or spatial activation. This is achieved by computing a score that reflects the contribution of a feature to the overall prediction. The scoring function can be implemented using a lightweight neural module or attention-like operation that assigns higher weights to informative features and lower weights to less relevant ones.

3.2.1 Hierarchical Feature Learning

3.4.2 Threshold-Based Suppression

CNN-based feature extraction forms the foundational stage of the proposed model. Convolutional layers apply learnable filters to input images, capturing low-level features such as edges and textures in early layers, and progressively learning higher-level semantic representations such as object parts and categories in deeper layers. This hierarchical learning process allows the network to build a structured understanding of visual data, which is essential for accurate image interpretation.

Once feature importance scores are computed, a thresholding strategy is applied to identify low-importance features. Features with scores below a predefined or dynamically learned threshold are suppressed by reducing their activation values. This process effectively removes noise and redundancy from the feature maps, ensuring that only meaningful information is propagated through the network.

3.4.3 Adaptive Weighting Strategy

3.2.2 Multi-Level Representation

In addition to threshold-based suppression, the DFSM employs an adaptive weighting mechanism that continuously adjusts feature importance during training.

Instead of completely discarding features, the model assigns varying weights based on their relevance. This adaptive approach allows the network to dynamically refine its feature representation, improving both learning efficiency and generalization performance.

The extracted features are organized into multiple levels corresponding to different depths of the network. Each level encodes distinct information: shallow layers retain spatial details, while deeper layers capture semantic context. By preserving and utilizing these multi-level representations, the model can effectively combine fine-grained details with broader contextual information, forming a comprehensive feature space for subsequent processing.

4. IMPLEMENTATION DETAILS

3.3 Hierarchical Attention Mechanism

4.1 Development Environment

3.3.1 Attention at Multiple Layers

4.1.1 Python-Based Implementation

The hierarchical attention mechanism is designed to operate at various stages of the CNN architecture rather than being limited to a single layer. Attention modules are embedded within intermediate and deeper layers, enabling the model to selectively focus on relevant features at different levels of

© 2026, IRJET

|

Impact Factor value: 8.226

The proposed Hierarchical Attention-Guided Deep Convolutional Network is implemented using the Python programming language due to its flexibility, extensive community support, and rich ecosystem of machine learning

|

ISO 9001:2008 Certified Journal

|

Page 3693

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

libraries. Python enables rapid prototyping and efficient experimentation, which are essential for developing and validating deep learning models. Its compatibility with scientific computing tools allows seamless integration of data preprocessing, model design, and performance evaluation within a unified environment.

4.3.2 ImageNet Dataset The ImageNet dataset provides a large-scale collection of over 14 million labeled images across thousands of categories. It is widely used for training deep learning models due to its diversity and complexity. ImageNet enables the proposed model to learn rich feature representations and evaluate its scalability in handling realworld image data.

4.1.2 GPU/CPU Configuration The implementation is executed on a computing environment that supports both CPU and GPU processing.

While CPUs handle general-purpose computations and data preprocessing tasks, GPUs significantly accelerate deep learning operations by enabling parallel processing of largescale matrix computations. A system equipped with a modern multi-core processor, sufficient RAM (e.g., 16 GB or higher), and a CUDA-enabled GPU is used to ensure efficient model training and reduced execution time. This configuration enhances scalability and supports experimentation with large datasets and deep architectures.

4.3.3 COCO Dataset The COCO dataset focuses on context-aware image understanding by providing images with multiple objects and detailed annotations. It contains over 300,000 images and supports tasks such as object detection and segmentation. COCO is particularly relevant for evaluating the proposed model’s ability to capture contextual relationships within complex scenes.

4.4 Data Preprocessing

4.2 Tools and Libraries

4.4.1 Normalization Data normalization is applied to standardize pixel intensity values across all input images. Typically, pixel values are scaled to a range between 0 and 1 or normalized using mean and standard deviation. This process ensures numerical stability during training and helps accelerate convergence by reducing variations in input data distribution.

4.2.1 Deep Learning Frameworks: TensorFlow / PyTorch The model is developed using advanced deep learning frameworks such as TensorFlow and PyTorch, which provide robust tools for building and training neural networks. These frameworks support automatic differentiation, efficient tensor operations, and GPU acceleration. TensorFlow, along with its high-level API Keras, offers a structured approach for model development, while PyTorch provides a dynamic computation graph that is highly suitable for research-oriented experimentation and customization.

4.4.2 Data Augmentation Data augmentation techniques are employed to increase dataset diversity and improve model generalization.

Common augmentation methods include rotation, horizontal flipping, scaling, translation, and brightness adjustment.

These transformations simulate variations in real-world conditions, enabling the model to learn invariant features and reducing the risk of overfitting.

4.2.2 Supporting Libraries: NumPy, OpenCV, Matplotlib In addition to deep learning frameworks, several supporting libraries are used to facilitate data handling and visualization. NumPy is utilized for numerical computations and array manipulations, while OpenCV is employed for image processing tasks such as resizing and transformation.

Matplotlib is used to visualize training progress, performance metrics, and feature maps, aiding in the interpretation of experimental results.

4.4.3 Dataset Splitting The dataset is divided into training, validation, and testing subsets to ensure unbiased performance evaluation.

Typically, 70% of the data is used for training, 15% for validation, and 15% for testing. The training set is used to learn model parameters, the validation set is used for hyperparameter tuning, and the testing set is used to evaluate final model performance on unseen data.

4.3 Dataset Description

4.5 Training Strategy

4.3.1 CIFAR-10 Dataset The CIFAR-10 dataset is used as a standard benchmark for evaluating image classification models. It consists of 60,000 color images categorized into 10 classes, with 50,000 images for training and 10,000 for testing. Due to its relatively small size and balanced class distribution, CIFAR-10 is suitable for validating model performance and conducting initial experiments.

© 2026, IRJET

|

Impact Factor value: 8.226

4.5.1 Hyperparameters: Learning Rate, Batch Size, Epochs The training process is guided by several key hyperparameters that influence model performance. The learning rate controls the step size of parameter updates during optimization, with smaller values ensuring stable convergence and larger values enabling faster learning.

|

ISO 9001:2008 Certified Journal

|

Page 3694

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

Batch size determines the number of samples processed in each training iteration, affecting both memory usage and convergence behavior. The number of epochs defines how many times the model iterates over the entire training dataset, allowing sufficient learning of feature representations.

precision and recall. In this study, the F1-score is used to assess how well the proposed model maintains a balance between minimizing false positives and false negatives.

4.5.2 Optimization Techniques

The performance of the proposed Hierarchical AttentionGuided Deep Convolutional Network is compared with traditional CNN models and attention-based CNN architectures. Conventional CNNs primarily focus on local feature extraction and often fail to capture contextual dependencies, resulting in moderate performance.

Attention-based CNNs improve upon this by emphasizing important regions within images, leading to better accuracy.

However, they typically operate at a single level and may still include redundant features.

5.2 Performance Comparison 5.2.1 CNN vs Attention-Based CNN vs Proposed Model

To optimize model performance, advanced optimization algorithms such as Adam or stochastic gradient descent (SGD) are employed. These techniques adjust model weights based on gradient information to minimize the loss function.

Regularization methods such as dropout and weight decay may also be incorporated to prevent overfitting and improve generalization. Additionally, learning rate scheduling can be applied to dynamically adjust the learning rate during training, ensuring efficient convergence and improved stability of the model.

The proposed model outperforms both approaches by integrating hierarchical attention with dynamic feature suppression. This combination enables the model to capture multi-level contextual information while simultaneously reducing noise and redundancy in feature representations.

Experimental results demonstrate higher accuracy, precision, recall, and F1-score for the proposed model, confirming its effectiveness in context-aware image understanding.

5. EXPERIMENTAL RESULTS AND DISCUSSION 5.1 Evaluation Metrics 5.1.1 Accuracy Accuracy is one of the most widely used metrics for evaluating classification models, representing the proportion of correctly predicted instances out of the total number of samples. In the context of this research, accuracy measures how effectively the proposed model classifies images into their respective categories. While accuracy provides an overall performance indication, it may not fully reflect model behavior in imbalanced datasets, which necessitates the use of additional evaluation metrics.

5.3 Ablation Study 5.3.1 Model Without Attention Mechanism To evaluate the contribution of the hierarchical attention mechanism, an ablation study is conducted by removing the attention modules from the architecture. The resulting model behaves similarly to a standard CNN, showing reduced performance due to its inability to focus on contextually relevant features. This highlights the importance of attention in enhancing feature representation.

5.1.2 Precision Precision evaluates the correctness of positive predictions made by the model. It is defined as the ratio of true positive predictions to the total number of predicted positives. High precision indicates that the model produces fewer false positives, which is particularly important in applications where incorrect positive predictions can lead to critical errors, such as medical diagnosis or security systems.

5.3.2 Model Without Dynamic Feature Suppression (DFSM) In this experiment, the dynamic feature suppression mechanism is removed while retaining the attention modules. Although the model still benefits from attentionbased feature refinement, it suffers from redundancy and noise in the feature maps. This leads to slightly lower performance compared to the full model, demonstrating the significance of DFSM in improving efficiency and feature quality.

5.1.3 Recall Recall measures the model’s ability to correctly identify all relevant instances in the dataset. It is defined as the ratio of true positive predictions to the total number of actual positive instances. A high recall value indicates that the model successfully captures most of the relevant data points, making it essential for applications where missing important instances is undesirable.

5.3.3 Full Model Performance The complete model, incorporating both hierarchical attention and DFSM, achieves the best performance among all configurations. The synergy between attention-based feature enhancement and dynamic feature suppression enables the model to learn more discriminative and

5.1.4 F1-Score The F1-score is the harmonic mean of precision and recall, providing a balanced evaluation of the model’s performance.

It is particularly useful when there is a trade-off between

© 2026, IRJET

|

Impact Factor value: 8.226

|

ISO 9001:2008 Certified Journal

|

Page 3695

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

6. CONCLUSION

contextually relevant representations. This validates the effectiveness of the proposed architecture and its individual components.

This research presented a novel Hierarchical AttentionGuided Deep Convolutional Network (HAG-DCN) integrated with a Dynamic Feature Suppression Mechanism (DFSM) for enhanced context-aware image understanding. The study addressed key limitations of conventional convolutional neural networks, including weak contextual dependency modeling, redundant feature extraction, and the absence of adaptive feature refinement. By incorporating hierarchical attention across multiple layers, the proposed model effectively captured both local and global contextual relationships, enabling a more comprehensive interpretation of complex visual scenes.

5.4 Visualization Results 5.4.1 Feature Maps Visualization of feature maps provides insights into how the model processes input images at different layers. Early layers capture basic patterns such as edges and textures, while deeper layers encode more complex semantic features.

In the proposed model, feature maps appear more refined and less noisy due to the influence of attention and suppression mechanisms, indicating improved feature learning.

The introduction of the DFSM further strengthened the framework by dynamically identifying and suppressing lowimportance features, thereby reducing noise and redundancy in feature representations. This not only improved model efficiency but also enhanced classification performance.

Experimental evaluation on benchmark datasets demonstrated that the proposed approach consistently outperformed traditional CNNs and single-level attentionbased models across multiple metrics, including accuracy, precision, recall, and F1-score.

5.4.2 Attention Heatmaps Attention heatmaps illustrate the regions of an image that the model focuses on during prediction. The proposed model generates more precise and concentrated heatmaps, highlighting relevant objects and contextual areas while suppressing background noise. This demonstrates the model’s ability to effectively identify and prioritize important visual information.

The improved performance of the proposed model can be attributed to its ability to combine hierarchical attention with dynamic feature suppression. This integration allows the model to focus on meaningful features while eliminating redundant information, resulting in more accurate and efficient learning.

The ablation study validated the individual contributions of hierarchical attention and feature suppression, confirming their synergistic impact on overall performance.

Additionally, visualization results highlighted the model’s ability to focus on relevant regions while minimizing background interference. Overall, the proposed framework offers a robust, scalable, and efficient solution for contextaware image understanding, with strong potential for realworld applications such as autonomous systems, medical imaging, and intelligent surveillance.

5.5.2 Role of Hierarchical Attention

7. FUTURE SCOPE OF RESEARCH

5.5 Discussion 5.5.1 Reasons for Performance Improvement

Hierarchical attention plays a crucial role in capturing contextual dependencies at multiple levels of the network.

By applying attention across different layers, the model gains the ability to analyze both fine-grained details and high-level semantic relationships. This multi-level understanding enhances the model’s capability to interpret complex visual scenes.

Future research can extend this work by integrating transformer-based architectures to further enhance global context modeling and improve scalability. The proposed framework can also be optimized for real-time applications by reducing computational complexity and enabling deployment on edge devices. Exploring multimodal learning by combining visual data with textual or sensor inputs may further improve contextual understanding in complex environments. Additionally, adaptive thresholding strategies in the DFSM can be refined using reinforcement learning or meta-learning approaches to improve dynamic feature selection. Expanding the model’s applicability to domainspecific tasks such as medical diagnosis or remote sensing can also provide valuable insights.

5.5.3 Impact of Feature Suppression The dynamic feature suppression mechanism significantly improves model efficiency by reducing noise and redundancy in feature maps. By selectively attenuating less important features, the model focuses on the most informative representations, leading to better generalization and reduced computational overhead. Together, these components contribute to a robust and scalable solution for context-aware image understanding.

© 2026, IRJET

|

Impact Factor value: 8.226

|

ISO 9001:2008 Certified Journal

|

Page 3696

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 13 Issue: 04 | Apr 2026

p-ISSN: 2395-0072

www.irjet.net

REFERENCES

13. Huang, G., Liu, Z., Van Der Maaten, L. and Weinberger, K.Q. (2017) ‘Densely connected convolutional networks’, CVPR. 14. Tan, M. and Le, Q. (2019) ‘EfficientNet: Rethinking model scaling for CNNs’, ICML. 15. Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W. and Chua, T.S. (2017) ‘SCA-CNN: Spatial and channel-wise attention in convolutional networks’, CVPR. 16. Liu, Y., Shao, Z. and Hoffmann, N. (2021) ‘Global attention mechanism for vision networks’, arXiv preprint.

17. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A. and Zagoruyko, S. (2020) ‘End-to-end object detection with transformers (DETR)’, ECCV. 18. Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A. and Jégou, H. (2021) ‘Training data-efficient image transformers’, ICML. 19. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S. and Guo, B. (2021) ‘Swin Transformer’, ICCV. 20. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A. and Torralba, A. (2016) ‘Learning deep features for discriminative localization’, CVPR. 21. Hu, H., Gu, J., Zhang, Z., Dai, J. and Wei, Y. (2018) ‘Relation networks for object detection’, CVPR. 22. Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K. and Yuille, A.L. (2018) ‘DeepLab: Semantic image segmentation’, IEEE TPAMI. 23. Cordts, M. et al. (2016) ‘The Cityscapes dataset for semantic urban scene understanding’, CVPR. 24. Molchanov, P., Tyree, S., Karras, T., Aila, T. and Kautz, J. (2017) ‘Pruning convolutional neural networks’, ICLR. 25. Luo, J.H., Wu, J. and Lin, W. (2017) ‘ThiNet: A filter level pruning method’, ICCV. 26. Howard, A.G. et al. (2017) ‘MobileNets: Efficient convolutional neural networks’, arXiv. 27. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A. and Chen, L.C. (2018) ‘MobileNetV2’, CVPR.earning Representations (ICLR).cision-making systems.

1.

Yann LeCun, Yoshua Bengio and Geoffrey Hinton (2015) ‘Deep learning’, Nature, 521(7553), pp. 436– 444.

2. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser and Illia Polosukhin (2017) ‘Attention is all you need’, Advances in Neural Information Processing Systems (NeurIPS).

3. Jie Hu, Li Shen and Gang Sun (2018) ‘Squeeze-andExcitation Networks’, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7132–7141.

4. Sanghyun Woo, Jongchan Park, Joon-Young Lee and In So Kweon (2018) ‘CBAM: Convolutional Block Attention Module’, Proceedings of the European Conference on Computer Vision (ECCV), pp. 3–19.

5. Xiaolong Wang, Ross Girshick, Abhinav Gupta and Kaiming He (2018) ‘Non-local Neural Networks’, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7794–7803.

6. Hengshuang Zhao, Jianping Shi, Xiaojuan Qi, Xiaogang Wang and Jiaya Jia (2017) ‘Pyramid Scene Parsing Network’, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.

2881–2890.

7. Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit and Neil Houlsby (2021) ‘An image is worth 16×16 words: Transformers for image recognition at scale’, International Conference on LGuo, M.H., Xu, T.X., Liu, J.J., Liu, Z.N., Jiang, P.T., Mu, T.J., Zhang, S.H., Martin, R.R., Cheng, M.M. and Hu, S.M. (2022) ‘Attention mechanisms in computer vision: A survey’, Computational Visual Media, 8(3), pp. 331– 368.

8. Yin, S., Li, H., Teng, L., Laghari, A.A., Almadhor, A., Gregus, M. and Sampedro, G.A. (2024) ‘Brain CT image classification based on Mask R-CNN and attention mechanism’, Scientific Reports, 14, 29300.

9. Yang, X. (2020) ‘An overview of attention mechanisms in computer vision’, Journal of Physics: Conference Series, 1693(1), 012173.

10. Krizhevsky, A., Sutskever, I. and Hinton, G.E. (2012) ‘ImageNet classification with deep convolutional neural networks’, NeurIPS. 11. Simonyan, K. and Zisserman, A. (2015) ‘Very deep convolutional networks for large-scale image recognition’, ICLR. 12. He, K., Zhang, X., Ren, S. and Sun, J. (2016) ‘Deep residual learning for image recognition’, CVPR.

© 2026, IRJET

|

Impact Factor value: 8.226

|

ISO 9001:2008 Certified Journal

|

Page 3697