International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
DEVELOPMENT OF A HIERARCHICAL ATTENTION-GUIDED DEEP
CONVOLUTIONAL NETWORK FOR CONTEXT-AWARE IMAGE UNDERSTANDING WITH DYNAMIC FEATURE SUPPRESSION IN PYTHON
Km. Mahima Verma1, Mrs. Arifa Khan2
1Master of Technology, Computer Science and Engineering, Lucknow Institute of Technology, Lucknow, India 2Assistant Professor, Department of Computer Science and Engineering, Lucknow Institute of Technology, Lucknow, India
Abstract - Recent advancements in deep learning have significantly enhanced the capabilities of computer vision systems; however, conventional Convolutional Neural Networks (CNNs) still face limitations in capturing complex contextual relationships and handling redundant feature representations. These challenges often lead to suboptimal performanceincontext-awareimageunderstandingtasks.To addresstheseissues,thispaperproposesa novelHierarchical Attention-Guided Deep Convolutional Network (HAG-DCN) integrated with a Dynamic Feature Suppression Mechanism (DFSM). The proposed architecture employs multi-level attentionmodulestocapturebothlocalandglobalcontextual dependencies across different layers of the network. Simultaneously, the DFSM selectively suppresses lowimportanceandnoisyfeatureactivations,enablingthemodel tofocus onthemost informativevisualpatterns. The modelis implemented using Python-based deep learning frameworks and evaluated on benchmark datasets including CIFAR-10, ImageNet, and COCO. Experimental results demonstrate that the proposed approach outperforms traditional CNN and single-level attention-based models in terms of accuracy, precision,recall,andF1-score.Furthermore,theintegrationof hierarchical attention and dynamic feature suppression reduces computational redundancy and enhances model efficiency.Thefindingsindicatethattheproposedframework significantlyimprovescontext-awareimageunderstandingby effectively modeling semantic relationships and refining feature representations. This research contributes a robust and scalable solution for advanced computer vision applications such as autonomous systems, medical imaging, and intelligent surveillance.
Key Words: Hierarchical Attention,Context-Aware Image Understanding, Dynamic Feature Suppression, Deep Convolutional Neural Networks, Computer Vision, Deep Learning
1. INTRODUCTION
1.1 Background
1.1.1
Evolution of Computer Vision Using Deep Learning
Computervisionhasundergoneasignificanttransformation withthe adventof deeplearning, particularlythroughthe useofdeepconvolutionalneuralnetworks(CNNs).Earlier approachesreliedonhandcraftedfeaturessuchasSIFTand HOG, which often struggled to generalize across complex visual environments. The introduction of deep learning enabledautomaticfeatureextractionfromrawimagedata, allowing models to learn hierarchical representations ranging from low-level edges to high-level semantic concepts. Landmark developments such as deep CNN architectures and attention-based models have further improved performance in tasks like image classification, objectdetection,andsegmentation.Morerecently,attention mechanisms and transformer-based architectures have demonstratedtheabilitytomodellong-rangedependencies, marking a shift toward more context-aware visual understanding(Vaswanietal.,2017;LeCunetal.,2015).
1.1.2 Importance of Context-Aware Understanding in Real-World Systems
Inreal-worldscenarios,understandingvisualdatarequires more than recognizing isolated objects; it demands the abilitytointerpretrelationshipsbetweenobjectsandtheir surrounding environment. Context-aware image understanding enables systems to derive meaningful insights by considering spatial, semantic, and relational dependencieswithinanimage.Thiscapabilityisessentialin applicationssuchasautonomousdriving,whererecognizing interactions between vehicles, pedestrians, and road conditions is critical, and in medical imaging, where contextual patterns help identify abnormalities. By incorporatingcontextualawareness,deeplearningmodels canachievemoreaccurateandreliablepredictions,thereby enhancingdecision-makingprocessesinintelligentsystems (Zhaoetal.,2017).
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
1.2 Problem Statement
1.2.1 Weak Contextual Dependency Modeling in CNNs Despitetheirsuccess,conventionalCNNsprimarilyfocuson localfeatureextractionduetotheirlimitedreceptivefields, which restricts their ability to capture long-range dependencies across different regions of an image. This limitation leads to incomplete scene understanding, particularlyincomplexenvironmentswhererelationships betweendistantobjectsplayacrucialrole.Althoughdeeper architecturespartiallyaddressthisissue,theystillstruggle to model global context effectively, necessitating the integration of advanced mechanisms such as attention modules(Wangetal.,2018).
1.2.2 Redundant
Feature Extraction in Deep Networks
AnothermajorlimitationofdeepCNNsisthegenerationof redundant or overlapping feature representations. As the networkdepthincreases,multiplelayersmaylearnsimilar or less informative features, resulting in inefficiencies in both computation and learning. This redundancynot only increases model complexity but can also degrade performance by introducing unnecessary noise into the featurespace(Huetal.,2018).
1.2.3 Lack of Adaptive Feature
Suppression Mechanisms
Most traditional CNN architectures treat all extracted features with equal importance, lacking mechanisms to dynamically suppress irrelevant or low-contributing features.Inreal-worldimages,backgroundclutterandnoise often lead to the extraction of non-informative features, whichcannegativelyimpactmodelaccuracy.Theabsenceof adaptive feature suppression prevents the model from focusingonthemostdiscriminativeregions,highlightingthe need for dynamic feature filtering techniques (Woo et al., 2018).
1.3 Research Objectives
1.3.1 Design of Hierarchical Attention-Based
CNN
Thefirstobjectiveofthisresearchistodesignahierarchical attention-guided CNN architecture that can capture contextual dependencies at multiple levels of feature representation. By integrating attention modules across different layers, the model aims to enhance its ability to focusonrelevantspatialandsemanticinformation,thereby improvingoverallimageunderstanding.
1.3.2 Implementation of Dynamic FeatureSuppression
The second objective is to develop a dynamic feature suppressionmechanismthatcanautomaticallyidentifyand reduce the influence of redundant or irrelevant features. This mechanism is intended to improve feature selection
efficiency and reduce noise within deep feature maps, leadingtobettermodelgeneralization.
1.3.3 Improvement of Contextual Understanding
The final objective is to enhance context-aware image understanding by combining hierarchical attention and dynamicfeaturesuppression.Thisintegratedapproachaims toimprove the model’sabilitytointerpretcomplexvisual scenesbycapturingbothlocaldetailsandglobalcontextual relationships.
1.4 Contributions of the Paper
1.4.1 Multi-Level Hierarchical Attention Integration
This paper introduces a novel hierarchical attention framework that operates across multiple layers of a deep convolutional network. Unlike conventional single-level attention mechanisms, the proposed approach captures contextual dependencies at different abstraction levels, enabling a more comprehensive understanding of visual data.
1.4.2
Dynamic Feature Suppression Layer (DFSL)
Akeycontributionofthisresearchisthedevelopmentofa Dynamic Feature Suppression Layer (DFSL), which selectively suppresses low-importance feature activations during training. This adaptive mechanism reduces redundancy and enhances the quality of learned representations, improving both efficiency and interpretability.
1.4.3
Improved Efficiency and Accuracy
Bycombininghierarchical attention with dynamic feature suppression, the proposed model achieves improved computationalefficiencyandhigherpredictionaccuracy.The reduction of redundant features and enhanced focus on relevant information contribute to better performance acrossvariousevaluationmetrics.
1.4.4
Comparative Evaluation with Existing Models
The proposed framework is extensively evaluated against traditionalCNNsandexistingattention-basedmodelsusing benchmark datasets. The results demonstrate superior performanceintermsofaccuracy,precision,recall,andF1score,validatingtheeffectivenessoftheproposedapproach incontext-awareimageunderstandingtasks.
2. LITERATURE REVIEW
2.1 Deep Convolutional Neural Networks
2.1.1
CNN Evolution and Limitations
DeepConvolutionalNeuralNetworks(CNNs)havebeenthe cornerstoneofmoderncomputervision,enablingsignificant improvementsintaskssuchasimageclassification,object detection, and segmentation. Early architectures
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
demonstrated that hierarchical feature learning could replacehandcrafteddescriptorsbyautomaticallyextracting low-level to high-level representations from images. Over time,deeperandmoresophisticatedCNNmodelsimproved accuracy and generalization. However, despite these advancements,CNNsinherentlyrelyonlocalreceptivefields, whichlimitstheirabilitytocapturelong-rangedependencies andglobalcontextualrelationships.Additionally,increasing networkdepthoftenleadstoredundancyinlearnedfeatures andhighercomputationalcost,whichcannegativelyaffect efficiencyandscalability(LeCunetal.,2015).
2.2 Attention Mechanisms in Vision
2.2.1
Spatial, Channel, and Self-Attention
Attentionmechanismshaveemergedasapowerfulsolution to overcome the limitations of conventional CNNs by enablingmodelstofocusselectivelyonimportantfeatures. Spatialattentionidentifiesrelevantregionswithinanimage, while channel attention emphasizes informative feature maps across different channels. These mechanisms help refine feature representations by suppressing less useful information.Self-attentionfurtherextendsthisconceptby modeling relationships between all elements in a feature map,allowingthenetworktocapturebothlocalandglobal dependencies effectively. Such mechanisms significantly enhancetherepresentationalpowerofdeeplearningmodels incomplexvisualtasks(Wooetal.,2018).
2.2.2
Influence of Transformer-Based Architectures
The introduction of transformer-based architectures has revolutionized computer vision by demonstrating the effectiveness of self-attention in modeling global context. UnlikeCNNs,transformersprocessimagesassequencesof patches and compute relationships between all regions simultaneously. This approach enables better context modeling and long-range dependency learning. Vision Transformersandtheirvariantshaveachievedstate-of-theart performance in multiple vision tasks, highlighting the importanceofattention-drivenfeaturelearning.However, these models often require large datasets and high computational resources, which limits their practical deploymentinsomeapplications(Dosovitskiyetal.,2021).
2.3 Context-Aware Image Understanding
2.3.1
Importance of Contextual Relationships
Context-awareimageunderstandingfocusesoninterpreting visual data by considering relationships between objects, regions,andtheoverallscene.Inmanyreal-worldscenarios, themeaningofanobjectdependsheavilyonitssurrounding context. For instance, identifying a pedestrian in a traffic scene requires understanding its relationship with roads, vehicles,andsignals.Traditionalmodelsthatfocussolelyon object-levelfeaturesoftenfailtocapturesuchdependencies, leading to incomplete or inaccurate predictions.
Incorporating contextual relationships enables models to achieveamoreholisticunderstandingofimages,improving both accuracy and robustness in complex environments (Zhaoetal.,2017).
2.4 Feature Selection and Suppression Techniques
2.4.1
Redundancy Problem in Deep Networks
Deep neural networks often generate a large number of feature maps, many of which may contain redundant or irrelevant information. This redundancy arises due to repeatedfeatureextractionacrosslayersandtheabsenceof mechanismstofilterunnecessaryinformation.Asaresult, modelsmaysufferfromincreasedcomputationalcomplexity andreducedefficiency.Featureselectionandsuppression techniques aim to address this issue by identifying and retainingonlythemostinformativefeatures.Methodssuch aschannelrecalibrationandattention-basedfilteringhave shown effectiveness in improving feature quality and reducing noise, thereby enhancing overall model performance(Huetal.,2018).
2.5 Research Gap
Althoughattentionmechanismshavebeenwidelyadoptedin computervision,mostexistingapproachesapplyattentionat a single level of the network. This limits their ability to capture multi-scale and hierarchical contextual dependencies, which are essential for understanding complexvisualscenes.Thereisaneedforarchitecturesthat integrate attention mechanisms across multiple layers to enable comprehensive feature learning. Current deep learningmodelsoftenlackdynamicmechanismstosuppress irrelevant or low-importance features during training. Without adaptive feature suppression, networks may continue to process noisy or redundant information, reducing both efficiency and accuracy. This highlights the necessityforintelligentfeaturefilteringstrategiesthatcan operate dynamically based on input data characteristics. Despiteprogressinattention-basedmodels,manyexisting systemsstillstruggletobalancelocalfeatureextractionwith globalcontextunderstanding.CNNsexcelatcapturinglocal patterns, while attention-based models focus on global relationships,butfewapproacheseffectivelyintegrateboth aspects.Thisgapindicatestheneedforaunifiedframework thatcombineshierarchicalattentionwithadaptivefeature suppressiontoachieveefficientandrobustcontext-aware imageunderstanding.
3. PROPOSED METHODOLOGY
3.1 Overview of Proposed Framework
3.1.1 Pipeline Diagram Explanation
Theproposedmethodologyisstructuredasaunifieddeep learningpipelinedesignedtoenhancecontext-awareimage understandingthrougheffectivefeaturerepresentationand
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
refinement. The framework begins with input image acquisition followed by preprocessing steps such as normalizationandaugmentation.Theprocessedimagesare then passed through convolutional layers for feature extraction.Thesefeaturesaresubsequentlyrefinedusinga hierarchical attention mechanism that operates across multiple levelsofthe network.Finally,a DynamicFeature Suppression Mechanism (DFSM) is applied to filter out redundantorlow-importancefeaturesbeforeclassification. Thepipelineensuresasystematicflowofinformation,where each stage contributes to improving the quality and relevanceoflearnedrepresentations.
3.1.2 Integration of CNN, Attention, and DFSM
The core strength of the proposed framework lies in the seamless integration of Convolutional Neural Networks (CNNs),hierarchicalattentionmodules,andtheDFSM.CNNs serve as the backbone for extracting hierarchical visual features, while attention modules selectively emphasize contextually important regions. The DFSM further refines thesefeaturesbysuppressingnoise andredundancy.This integrated design enables the model to capture both discriminativeandcontextualinformationefficiently,leading toimprovedperformanceincomplexvisualtasks.
3.2 CNN-Based Feature Extraction
3.2.1
Hierarchical Feature Learning
CNN-basedfeatureextractionformsthefoundationalstage oftheproposedmodel.Convolutionallayersapplylearnable filterstoinputimages,capturinglow-levelfeaturessuchas edges and textures in early layers, and progressively learning higher-level semantic representations such as object parts and categories in deeper layers. This hierarchicallearningprocessallowsthenetworktobuilda structuredunderstandingofvisualdata,whichisessential foraccurateimageinterpretation.
3.2.2 Multi-Level
Representation
The extracted features are organized into multiple levels correspondingtodifferentdepthsofthenetwork.Eachlevel encodesdistinctinformation:shallowlayersretainspatial details, while deeper layers capture semantic context. By preservingandutilizing these multi-level representations, themodelcaneffectivelycombinefine-graineddetailswith broadercontextualinformation,formingacomprehensive featurespaceforsubsequentprocessing.
3.3 Hierarchical Attention Mechanism
3.3.1
Attention at Multiple Layers
Thehierarchicalattentionmechanismisdesignedtooperate atvariousstagesoftheCNNarchitectureratherthanbeing limitedtoasinglelayer.Attentionmodulesareembedded withinintermediateanddeeperlayers,enablingthemodel toselectivelyfocusonrelevantfeaturesatdifferentlevelsof
abstraction.Thismulti-layerattentionstrategyenhancesthe model’s ability to distinguish important visual patterns acrossvaryingfeaturescales.
3.3.2
Capturing Global and Local Context
Bycombiningattentionacrossmultiplelayers,theproposed mechanism captures both local and global contextual dependencies.Localattentionfocusesonfinedetailswithin smallregions,whileglobalattentioncapturesrelationships betweendistantregionsinthe image.Thisdual capability allowsthemodeltounderstandcomplexvisualsceneswhere object relationships and contextual cues are critical for accurateinterpretation.
3.4 Dynamic Feature Suppression Mechanism (DFSM)
3.4.1
Feature Importance Scoring
The DFSM introduces a mechanism for evaluating the importanceofeachfeaturechannelorspatialactivation.This is achieved by computing a score that reflects the contribution of a feature to the overall prediction. The scoring function can be implemented using a lightweight neural module or attention-like operation that assigns higherweightstoinformativefeaturesandlowerweightsto lessrelevantones.
3.4.2
Threshold-Based Suppression
Once feature importance scores are computed, a thresholdingstrategyisappliedtoidentifylow-importance features. Features with scores below a predefined or dynamicallylearnedthresholdaresuppressedbyreducing their activation values. This process effectively removes noiseandredundancyfromthefeaturemaps,ensuringthat only meaningful information is propagated through the network.
3.4.3
Adaptive Weighting Strategy
In addition to threshold-based suppression, the DFSM employs an adaptive weighting mechanism that continuously adjusts feature importance during training. Insteadofcompletelydiscardingfeatures,themodelassigns varying weights based on their relevance. This adaptive approach allows the network to dynamically refine its featurerepresentation,improvingbothlearningefficiency andgeneralizationperformance.
4. IMPLEMENTATION DETAILS
4.1
Development Environment
4.1.1
Python-Based Implementation
The proposed Hierarchical Attention-Guided Deep Convolutional Network is implemented using the Python programming language due to its flexibility, extensive communitysupport,andrichecosystemofmachinelearning
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
libraries. Python enables rapid prototyping and efficient experimentation, which are essential for developing and validating deep learning models. Its compatibility with scientific computing tools allows seamless integration of data preprocessing, model design, and performance evaluationwithinaunifiedenvironment.
4.1.2
GPU/CPU Configuration
The implementation is executed on a computing environmentthatsupports bothCPUandGPUprocessing. WhileCPUshandlegeneral-purposecomputationsanddata preprocessing tasks, GPUs significantly accelerate deep learningoperationsbyenablingparallelprocessingoflargescale matrix computations. A system equipped with a modernmulti-coreprocessor,sufficientRAM(e.g.,16GBor higher),andaCUDA-enabledGPUisusedtoensureefficient model training and reduced execution time. This configuration enhances scalability and supports experimentationwithlargedatasetsanddeeparchitectures.
4.2 Tools and Libraries
4.2.1 Deep Learning Frameworks: TensorFlow / PyTorch
The model is developed using advanced deep learning frameworks such as TensorFlow and PyTorch, which provide robust tools for building and training neural networks. These frameworks support automatic differentiation, efficient tensor operations, and GPU acceleration.TensorFlow,alongwithitshigh-levelAPIKeras, offersastructuredapproachformodeldevelopment,while PyTorch provides a dynamic computation graph that is highlysuitableforresearch-orientedexperimentationand customization.
4.2.2
Supporting Libraries:NumPy,OpenCV,Matplotlib
Inadditiontodeeplearningframeworks,severalsupporting libraries are used to facilitate data handling and visualization.NumPyisutilizedfornumericalcomputations and array manipulations, while OpenCV is employed for imageprocessingtaskssuchasresizingandtransformation. Matplotlib is used to visualize training progress, performance metrics, and feature maps, aiding in the interpretationofexperimentalresults.
4.3 Dataset Description
4.3.1 CIFAR-10
Dataset
TheCIFAR-10datasetisusedasastandardbenchmarkfor evaluatingimageclassificationmodels.Itconsistsof60,000 colorimagescategorizedinto10classes,with50,000images fortrainingand10,000fortesting.Duetoitsrelativelysmall sizeandbalancedclassdistribution,CIFAR-10issuitablefor validating model performance and conducting initial experiments.
4.3.2
ImageNet Dataset
The ImageNet dataset provides a large-scale collection of over 14 million labeled images across thousands of categories. It is widely used for training deep learning models due to its diversity and complexity. ImageNet enables the proposed model to learn rich feature representationsandevaluateitsscalabilityinhandlingrealworldimagedata.
4.3.3 COCO Dataset
The COCO dataset focuses on context-aware image understanding by providing images with multiple objects anddetailedannotations.Itcontainsover300,000images and supports tasks such as object detection and segmentation.COCOisparticularlyrelevantforevaluating the proposed model’s ability to capture contextual relationshipswithincomplexscenes.
4.4 Data Preprocessing
4.4.1 Normalization
Datanormalizationisappliedtostandardizepixelintensity values across all input images. Typically, pixel values are scaledtoarangebetween0and1ornormalizedusingmean and standard deviation. This process ensures numerical stabilityduringtrainingandhelpsaccelerateconvergenceby reducingvariationsininputdatadistribution.
4.4.2 Data Augmentation
Data augmentation techniques are employed to increase dataset diversity and improve model generalization. Commonaugmentationmethodsincluderotation,horizontal flipping, scaling, translation, and brightness adjustment. These transformations simulate variations in real-world conditions, enabling the model to learn invariant features andreducingtheriskofoverfitting.
4.4.3 Dataset Splitting
Thedatasetisdividedintotraining,validation,andtesting subsets to ensure unbiased performance evaluation. Typically, 70% of the data is used for training, 15% for validation,and15%fortesting.Thetrainingsetisusedto learn model parameters, the validation set is used for hyperparameter tuning, and the testing set is used to evaluatefinalmodelperformanceonunseendata.
4.5 Training Strategy
4.5.1 Hyperparameters: Learning Rate, Batch Size, Epochs
The training process is guided by several key hyperparameters that influence model performance. The learning rate controls the step size of parameter updates during optimization, with smaller values ensuring stable convergence and larger values enabling faster learning.
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
Batchsizedeterminesthenumberofsamplesprocessedin each training iteration, affecting both memory usage and convergencebehavior.Thenumberofepochsdefineshow many times the model iterates over the entire training dataset, allowing sufficient learning of feature representations.
4.5.2
Optimization Techniques
To optimize model performance, advanced optimization algorithms such as Adam or stochastic gradient descent (SGD)areemployed.Thesetechniquesadjustmodelweights basedongradientinformationtominimizethelossfunction. Regularizationmethodssuchasdropoutandweightdecay mayalsobeincorporatedtopreventoverfittingandimprove generalization.Additionally,learningrateschedulingcanbe applied to dynamically adjust the learning rate during training, ensuring efficient convergence and improved stabilityofthemodel.
5. EXPERIMENTAL RESULTS AND DISCUSSION
5.1 Evaluation Metrics
5.1.1 Accuracy
Accuracy is one of the most widely used metrics for evaluatingclassificationmodels,representingtheproportion ofcorrectlypredictedinstancesoutofthetotalnumberof samples.Inthecontextofthisresearch,accuracymeasures how effectively the proposed model classifies images into their respective categories. While accuracy provides an overallperformanceindication,itmaynotfullyreflectmodel behaviorinimbalanceddatasets,whichnecessitatestheuse ofadditionalevaluationmetrics.
5.1.2 Precision
Precisionevaluatesthecorrectnessofpositivepredictions madebythemodel.Itisdefinedastheratiooftruepositive predictionstothetotalnumberofpredictedpositives.High precision indicates that the model produces fewer false positives, which is particularly important in applications where incorrect positive predictions can lead to critical errors,suchasmedicaldiagnosisorsecuritysystems.
5.1.3 Recall
Recallmeasuresthemodel’sabilitytocorrectlyidentifyall relevantinstancesinthedataset.Itisdefinedastheratioof true positive predictions to the total number of actual positive instances. A high recall value indicates that the modelsuccessfullycapturesmostoftherelevantdatapoints, makingitessentialforapplicationswheremissingimportant instancesisundesirable.
5.1.4
F1-Score
TheF1-scoreistheharmonicmeanofprecisionandrecall, providingabalancedevaluationofthemodel’sperformance. It is particularly useful when there is a trade-off between
precision and recall. In this study, the F1-score is used to assess how well the proposed model maintains a balance betweenminimizingfalsepositivesandfalsenegatives.
5.2 Performance Comparison
5.2.1
CNN vs Attention-Based CNN vs Proposed Model
The performance of the proposed Hierarchical AttentionGuided Deep Convolutional Network is compared with traditional CNN models and attention-based CNN architectures. Conventional CNNs primarily focus on local feature extraction and often fail to capture contextual dependencies, resulting in moderate performance. Attention-based CNNs improve upon this by emphasizing importantregionswithinimages,leadingtobetteraccuracy. However,theytypicallyoperateatasinglelevelandmaystill includeredundantfeatures.
The proposed model outperforms both approaches by integrating hierarchical attention with dynamic feature suppression.Thiscombinationenablesthemodeltocapture multi-level contextual information while simultaneously reducingnoiseandredundancyinfeaturerepresentations. Experimental results demonstrate higher accuracy, precision, recall, and F1-score for the proposed model, confirming its effectiveness in context-aware image understanding.
5.3 Ablation Study
5.3.1
Model Without Attention Mechanism
To evaluate the contribution of the hierarchical attention mechanism,anablationstudyisconductedbyremovingthe attention modules from the architecture. The resulting model behaves similarly to a standard CNN, showing reduced performance due to its inability to focus on contextually relevant features. This highlights the importanceofattentioninenhancingfeaturerepresentation.
5.3.2
Model Without Dynamic Feature Suppression (DFSM)
In this experiment, the dynamic feature suppression mechanism is removed while retaining the attention modules.Althoughthemodelstillbenefitsfromattentionbased feature refinement, it suffers from redundancy and noise in the feature maps. This leads to slightly lower performancecomparedtothefullmodel,demonstratingthe significance of DFSM in improving efficiency and feature quality.
5.3.3
Full Model Performance
The complete model, incorporating both hierarchical attentionandDFSM,achievesthebestperformanceamong all configurations. The synergy between attention-based feature enhancement and dynamic feature suppression enables the model to learn more discriminative and
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
contextually relevant representations. This validates the effectivenessoftheproposedarchitectureanditsindividual components.
5.4 Visualization Results
5.4.1 Feature Maps
Visualizationoffeaturemapsprovidesinsightsintohowthe model processes input images at different layers. Early layers capture basic patterns such as edges and textures, whiledeeperlayersencodemorecomplexsemanticfeatures. Intheproposedmodel,featuremapsappearmorerefined and less noisy due to the influence of attention and suppression mechanisms, indicating improved feature learning.
5.4.2 Attention Heatmaps
Attentionheatmapsillustratetheregionsofanimagethat themodelfocusesonduringprediction.Theproposedmodel generates more precise and concentrated heatmaps, highlighting relevant objects and contextual areas while suppressing background noise. This demonstrates the model’s ability to effectively identify and prioritize importantvisualinformation.
5.5 Discussion
5.5.1 Reasons for Performance Improvement
The improvedperformance ofthe proposedmodel canbe attributed to its ability to combine hierarchical attention withdynamicfeaturesuppression.Thisintegrationallows themodeltofocusonmeaningfulfeatureswhileeliminating redundant information, resulting in more accurate and efficientlearning.
5.5.2 Role of Hierarchical Attention
Hierarchical attention plays a crucial role in capturing contextualdependenciesatmultiplelevelsofthenetwork. Byapplyingattentionacrossdifferentlayers,themodelgains theabilitytoanalyzebothfine-graineddetailsandhigh-level semantic relationships. This multi-level understanding enhancesthemodel’scapabilitytointerpretcomplexvisual scenes.
5.5.3 Impact of Feature
Suppression
Thedynamicfeaturesuppressionmechanismsignificantly improves model efficiency by reducing noise and redundancyinfeaturemaps.Byselectivelyattenuatingless important features, the model focuses on the most informativerepresentations,leadingtobettergeneralization and reduced computational overhead. Together, these componentscontributetoarobustandscalablesolutionfor context-awareimageunderstanding.
6. CONCLUSION
This research presented a novel Hierarchical AttentionGuidedDeepConvolutionalNetwork(HAG-DCN)integrated withaDynamicFeatureSuppressionMechanism(DFSM)for enhanced context-aware image understanding. The study addressed key limitations of conventional convolutional neural networks, including weak contextual dependency modeling,redundantfeatureextraction,andtheabsenceof adaptivefeaturerefinement.Byincorporatinghierarchical attention across multiple layers, the proposed model effectively captured both local and global contextual relationships,enablingamorecomprehensiveinterpretation ofcomplexvisualscenes.
The introduction of the DFSM further strengthened the frameworkbydynamicallyidentifyingandsuppressinglowimportancefeatures,therebyreducingnoiseandredundancy in feature representations. This not only improved model efficiency but also enhanced classification performance. Experimental evaluation on benchmark datasets demonstrated that the proposed approach consistently outperformed traditional CNNsandsingle-level attentionbasedmodelsacross multiple metrics,includingaccuracy, precision,recall,andF1-score.
Theablationstudyvalidatedtheindividualcontributionsof hierarchicalattentionandfeaturesuppression,confirming their synergistic impact on overall performance. Additionally, visualization results highlighted the model’s ability to focus on relevant regions while minimizing backgroundinterference.Overall,theproposedframework offersarobust,scalable,andefficientsolutionforcontextawareimageunderstanding,withstrongpotentialforrealworld applications such as autonomous systems, medical imaging,andintelligentsurveillance.
7. FUTURE SCOPE OF RESEARCH
Future research can extend this work by integrating transformer-basedarchitecturestofurtherenhanceglobal context modeling and improve scalability. The proposed frameworkcanalsobeoptimizedforreal-timeapplications by reducing computational complexity and enabling deploymentonedgedevices.Exploringmultimodallearning bycombiningvisualdatawithtextualorsensorinputsmay further improve contextual understanding in complex environments.Additionally,adaptivethresholdingstrategies intheDFSMcanberefinedusingreinforcementlearningor meta-learning approaches to improve dynamic feature selection. Expanding the model’s applicability to domainspecifictaskssuchasmedicaldiagnosisorremotesensing canalsoprovidevaluableinsights.
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
REFERENCES
1. Yann LeCun, Yoshua Bengio and Geoffrey Hinton (2015) ‘Deep learning’, Nature, 521(7553), pp. 436–444.
2. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit,LlionJones,AidanN.Gomez,ŁukaszKaiser andIlliaPolosukhin(2017)‘Attentionisallyouneed’, Advances in Neural Information Processing Systems (NeurIPS).
3. Jie Hu, Li Shen and Gang Sun (2018) ‘Squeeze-andExcitation Networks’, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR),pp.7132–7141.
4. SanghyunWoo,JongchanPark,Joon-YoungLeeandIn SoKweon(2018)‘CBAM:ConvolutionalBlockAttention Module’,Proceedingsof the EuropeanConference on ComputerVision(ECCV),pp.3–19.
5. Xiaolong Wang, Ross Girshick, Abhinav Gupta and Kaiming He (2018) ‘Non-local Neural Networks’, Proceedings of the IEEE Conference on Computer VisionandPatternRecognition(CVPR),pp.7794–7803.
6. HengshuangZhao,JianpingShi,XiaojuanQi,Xiaogang Wang and Jiaya Jia (2017) ‘Pyramid Scene Parsing Network’, Proceedings of the IEEE Conference on ComputerVisionandPatternRecognition(CVPR),pp. 2881–2890.
7. AlexeyDosovitskiy,LucasBeyer,AlexanderKolesnikov, DirkWeissenborn,XiaohuaZhai,ThomasUnterthiner, MostafaDehghani,MatthiasMinderer,GeorgHeigold, SylvainGelly,JakobUszkoreitandNeilHoulsby(2021) ‘An image is worth 16×16 words: Transformers for imagerecognitionatscale’,InternationalConferenceon LGuo,M.H.,Xu,T.X.,Liu,J.J.,Liu,Z.N.,Jiang,P.T.,Mu,T.J., Zhang, S.H., Martin, R.R., Cheng, M.M. and Hu, S.M. (2022) ‘Attention mechanisms in computer vision: A survey’, Computational Visual Media, 8(3), pp. 331–368.
8. Yin, S., Li, H., Teng, L., Laghari, A.A., Almadhor, A., Gregus,M.andSampedro,G.A.(2024)‘BrainCTimage classification based on Mask R-CNN and attention mechanism’,ScientificReports,14,29300.
9. Yang,X.(2020)‘Anoverviewofattentionmechanisms in computer vision’, Journal of Physics: Conference Series,1693(1),012173.
10. Krizhevsky, A., Sutskever, I. and Hinton, G.E. (2012) ‘ImageNetclassificationwithdeepconvolutionalneural networks’,NeurIPS.
11. Simonyan, K. and Zisserman, A. (2015) ‘Very deep convolutional networks for large-scale image recognition’,ICLR.
12. He, K., Zhang, X., Ren, S. and Sun, J. (2016) ‘Deep residuallearningforimagerecognition’,CVPR.
13. Huang,G.,Liu,Z.,VanDerMaaten,L.andWeinberger, K.Q. (2017) ‘Densely connected convolutional networks’,CVPR.
14. Tan, M. and Le, Q. (2019) ‘EfficientNet: Rethinking modelscalingforCNNs’,ICML.
15. Chen,L.,Zhang,H.,Xiao,J.,Nie,L.,Shao,J.,Liu,W.and Chua,T.S.(2017)‘SCA-CNN:Spatialandchannel-wise attentioninconvolutionalnetworks’,CVPR.
16. Liu, Y., Shao, Z. and Hoffmann, N. (2021) ‘Global attention mechanism for vision networks’, arXiv preprint.
17. Carion,N.,Massa,F.,Synnaeve,G.,Usunier,N.,Kirillov, A. and Zagoruyko, S. (2020) ‘End-to-end object detectionwithtransformers(DETR)’,ECCV.
18. Touvron,H.,Cord,M.,Douze,M.,Massa,F.,Sablayrolles, A.andJégou,H.(2021)‘Trainingdata-efficientimage transformers’,ICML.
19. Liu,Z.,Lin,Y.,Cao,Y.,Hu,H.,Wei,Y.,Zhang,Z.,Lin,S. andGuo,B.(2021)‘SwinTransformer’,ICCV.
20. Zhou,B.,Khosla,A.,Lapedriza,A.,Oliva,A.andTorralba, A. (2016) ‘Learning deep features for discriminative localization’,CVPR.
21. Hu, H., Gu, J., Zhang, Z., Dai, J. and Wei, Y. (2018) ‘Relationnetworksforobjectdetection’,CVPR.
22. Chen,L.C.,Papandreou,G.,Kokkinos,I.,Murphy,K.and Yuille, A.L. (2018) ‘DeepLab: Semantic image segmentation’,IEEETPAMI.
23. Cordts, M. et al. (2016) ‘The Cityscapes dataset for semanticurbansceneunderstanding’,CVPR.
24. Molchanov,P.,Tyree,S.,Karras,T.,Aila,T.andKautz,J. (2017)‘Pruningconvolutionalneuralnetworks’,ICLR.
25. Luo,J.H.,Wu,J.andLin,W.(2017)‘ThiNet:Afilterlevel pruningmethod’,ICCV.
26. Howard, A.G. et al. (2017) ‘MobileNets: Efficient convolutionalneuralnetworks’,arXiv.
27. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A. and Chen, L.C. (2018) ‘MobileNetV2’, CVPR.earning Representations(ICLR).cision-makingsystems.