FRACE EMOTION CLASSIFICATION: A DEEP LEARNING APPROACHE

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 03 | Mar 2025

p-ISSN: 2395-0072

www.irjet.net

FRACE EMOTION CLASSIFICATION: A DEEP LEARNING APPROACHE 1Ms. CH. Ramya Bharathi, 2S. Nagamani, 3L. Reshma,4 M. Malleswari, 5M. Meghana, 6N. Renuka.

1Assistant Professor, Department of CSE(AI&ML), SRK Institute of Technology, Vijayawada, A.P., India.

2, 3, 4, 5, 6 Project Students, Department of CSE(AI&ML), SRK Institute of Technology, Vijayawada, A.P., India.

-----------------------------------------------------------------***---------------------------------------------------------------recognition. The system is designed as a web-based ABSTRACT: Face emotion classification has gained

application with a user-friendly interface, enabling realtime emotion detection from webcam input. In addition to emotion classification, the system provides gender and age predictions, offering a comprehensive facial analysis solution.

significant attention in the field of computer vision. This paper presents a web-based application utilizing deep learning techniques to classify facial emotions using live webcam input. The model is built using convolutional neural networks (CNNs) and leverages the DeepFace library for advanced emotion recognition. This study outlines the methodology, architecture, implementation, and evaluation of the proposed system, demonstrating its potential for realtime applications.

2. LITERATURE SURVEY Face emotion classification has been extensively studied over the past few decades. Early approaches primarily relied on conventional machine learning algorithms that extracted handcrafted features from facial images.

Techniques such as Local Binary Patterns (LBP), Gabor filters, and Principal Component Analysis (PCA) were commonly used to derive meaningful representations from facial features. However, these methods often faced challenges when dealing with variations in lighting, pose, and facial expressions.

Keywords Face Emotion Classification, Deep Learning, Convolutional Neural Networks, DeepFace, Real-Time Emotion Detection, Computer Vision

1. INTRODUCTION Facial expressions are a fundamental aspect of human communication, often conveying emotions and intentions more effectively than words. Recognizing and interpreting these emotions has numerous applications across various domains, including healthcare, entertainment, security, and human-computer interaction. Automated facial emotion classification is an interdisciplinary field that combines computer vision, artificial intelligence, and psychology to understand and categorize human emotions.

With the advent of deep learning, particularly Convolutional Neural Networks (CNNs), emotion recognition systems have seen substantial improvements.

CNNs are capable of automatically learning hierarchical features from images, making them highly effective for facial expression recognition. Popular architectures like VGGFace, ResNet, and MobileNet have been successfully applied to emotion classification tasks.Furthermore, transfer learning has enabled the use of pre-trained models to achieve state-of-the-art accuracy with limited computational resources. The DeepFace library, in particular, integrates advanced facial recognition models, providing robust and efficient face analysis. Studies have demonstrated that combining CNNs with transfer learning techniques significantly enhances emotion classification performance.

In recent years, the proliferation of deep learning techniques has led to significant advancements in emotion recognition. Convolutional Neural Networks (CNNs) have emerged as a powerful tool for image analysis, capable of learning complex patterns from visual data. By training CNNs on large-scale facial emotion datasets, researchers have achieved remarkable accuracy in emotion classification. However, the practical implementation of such models in real-time scenarios presents challenges, including computational efficiency, adaptability to diverse facial expressions, and robustness to variations in lighting and background.

In addition to model development, various datasets have been instrumental in advancing emotion recognition research. The FER2013 dataset, consisting of 35,887 labeled facial images across seven emotion categories, has become a benchmark for evaluating model performance.

Other datasets, such as CK+ and JAFFE, are also widely used for facial emotion analysis.

This research proposes a real-time facial emotion classification system that utilizes a pre-trained CNN model and the DeepFace library for enhanced emotion

© 2025, IRJET

|

Impact Factor value: 8.315

|

ISO 9001:2008 Certified Journal

|

Page 1166

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 03 | Mar 2025

p-ISSN: 2395-0072

www.irjet.net

While many studies have focused on improving classification accuracy, real-time implementation remains a challenge. Factors such as computational latency, memory constraints, and real-world variability often hinder the deployment of emotion recognition systems in practical applications. This research addresses these challenges by integrating a pre-trained DeepFace model within a web-based application, ensuring efficient and accurate real-time emotion classification.

2. Lack of Real-Time Performance Another significant limitation of existing systems is the inability to provide real-time performance. Many facial recognition models require large computational resources for training and inference, making them unsuitable for applications that demand instant feedback. Traditional models using Haar Cascades or Histogram of Oriented Gradients (HOG) for face detection are computationally efficient but lack the accuracy and adaptability offered by deep learning-based systems.

By conducting a comprehensive review of existing methods and identifying their limitations, this study aims to contribute a robust and practical solution for face emotion classification, with potential applications in diverse real-world scenarios.

Moreover, models based on traditional machine learning algorithms are often unable to process video streams efficiently. While they may perform well on static images, their performance deteriorates when faced with continuous video inputs. Real-time systems require not only rapid face detection but also the simultaneous classification of age, gender, and emotions. Existing solutions struggle to achieve this level of multi-tasking without significant delays. This limitation reduces their applicability in scenarios such as security surveillance, emotion analysis in retail environments, and humancomputer interaction.

3. EXISTING SYSTEM Face recognition technology has witnessed significant advancements over the years, offering various applications in identity verification, surveillance, and human-computer interaction. However, many existing systems are still limited in their capabilities when it comes to accurately detecting and classifying multiple facial attributes such as age, gender, and emotions in real time. This section explores the limitations of the existing systems in detail.

3. Accuracy and Bias Challenges The accuracy of existing face recognition systems is another critical concern. Many models are prone to errors when analyzing diverse facial features across different age groups, genders, and ethnicities. Bias in face recognition algorithms is a well-documented issue, often resulting in poor classification accuracy for underrepresented demographic groups. This bias is often a result of imbalanced training datasets that predominantly contain images from specific groups, leading to unfair and unreliable predictions.

1. Limited Emotion Recognition Most traditional face recognition systems primarily focus on identity verification rather than the detailed analysis of facial attributes. Systems like OpenCV and Dlib are widely used for face detection, but their emotion recognition capabilities remain limited. These systems often rely on handcrafted features and conventional machine learning algorithms like Support Vector Machines (SVM) or KNearest Neighbors (KNN) for classification. While they can classify basic emotions such as happiness, sadness, or anger, they struggle to capture subtle or complex emotions like contempt, surprise, or mixed emotions.

For instance, a model trained on a dataset with a higher representation of younger faces may struggle to predict the age of elderly individuals accurately. Similarly, gender classification models may show lower accuracy for individuals with androgynous facial features. Emotion recognition systems are also affected by cultural variations in facial expressions, further reducing their effectiveness in global applications.

Additionally, existing systems typically operate using static image datasets, making them unsuitable for real-time emotion detection. They fail to consider the dynamic nature of human facial expressions, which may change rapidly. Without robust deep learning integration, these systems lack the ability to adapt to various facial conditions, including changes in lighting, angles, and facial occlusions. Furthermore, poor generalization across different demographic groups often results in biased and inaccurate emotion recognition.

© 2025, IRJET

|

Impact Factor value: 8.315

Furthermore, the reliance on pre-trained models using static datasets often limits the ability of existing systems to adapt to real-world scenarios. Environmental factors such as poor lighting, low image resolution, and partially obscured faces further degrade their performance. While some systems attempt to mitigate these issues using image

|

ISO 9001:2008 Certified Journal

|

Page 1167

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 03 | Mar 2025

p-ISSN: 2395-0072

www.irjet.net

enhancement techniques, they often fail to maintain realtime performance.

primary modules include face detection, emotion classification, age and gender prediction, a user-friendly web interface, and real-time processing. By leveraging deep learning models, the system achieves reliable classification with minimal human intervention.

4. Inadequate User Interface and Integration In addition to technical limitations, many existing systems lack a user-friendly interface, making them difficult to deploy and operate. Systems without seamless integration with applications or web interfaces require manual processing, which significantly reduces their practicality in real-world scenarios. Users may face difficulties in accessing results, interpreting predictions, or understanding the system’s limitations.

Face Detection Face detection is the first and crucial step in the proposed system. Using the OpenCV library, the system captures live webcam input and applies Haar cascade classifiers or DNN-based models to detect human faces in real-time. The detected faces are enclosed in bounding boxes for further analysis. OpenCV's optimized algorithms ensure that detection is both efficient and accurate, supporting multiple face recognition in group scenarios. The face detection model is designed to handle varying lighting conditions, angles, and facial expressions, ensuring robustness in real-world applications.

Furthermore, existing models often lack multi-attribute classification capabilities. Most applications are designed to perform either age detection, gender classification, or emotion recognition independently. This fragmented approach reduces overall system efficiency and requires additional resources to run multiple models in parallel.

Emotion Classification For emotion recognition, the system utilizes the DeepFace library, which provides pre-trained Convolutional Neural Networks (CNNs) specialized in facial analysis. The model classifies emotions into seven distinct categories: Happy, Sad, Angry, Fear, Disgust, Surprise, and Neutral. By extracting facial features such as eyes, mouth, and facial expressions, the CNN model makes highly accurate predictions. Transfer learning is applied using the VGGFace model, further enhancing classification performance. The model also handles subtle facial expressions and complex emotional states using feature extraction and hierarchical learning techniques.

Age and Gender Prediction In addition to emotion recognition, the proposed system predicts the age and gender of the detected face. This is achieved using the VGGFace model, which is trained on large-scale datasets containing diverse facial images. The model analyzes facial features to estimate the user's age within a specific range and classifies gender as male or female. The age and gender prediction functionality is particularly beneficial for marketing analytics, customer profiling, and personalized recommendations.

Additionally, it provides valuable insights in social and psychological research.

Figure 1: Existing System Architecture

4. PROPOSED SYSTEM

User Interface

The proposed system is designed to provide real-time face emotion classification along with age and gender prediction. It comprises multiple components working together to ensure accurate results with low latency. The

© 2025, IRJET

|

Impact Factor value: 8.315

The system's front-end is developed using the Flask framework, providing an interactive and user-friendly web application. Users can access the system via a web

|

ISO 9001:2008 Certified Journal

|

Page 1168

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 03 | Mar 2025

p-ISSN: 2395-0072

www.irjet.net

browser, where real-time webcam footage is displayed.

Detected faces are outlined with bounding boxes, and the predicted emotions, ages, and genders are shown as onscreen overlays. The interface is designed for easy navigation, allowing both technical and non-technical users to interpret results effortlessly. Features such as real-time data visualization, adjustable detection settings, and result history are integrated to enhance user experience.

Real-Time Processing To ensure seamless real-time predictions, the system leverages GPU acceleration. TensorFlow and Keras are used to optimize model inference, minimizing latency during face detection and classification. Efficient memory management and parallel processing enable the system to maintain responsive performance even when analyzing multiple faces simultaneously. This makes it ideal for applications requiring instant feedback, such as customer sentiment analysis and security surveillance. Additionally, the system is capable of handling continuous video streams without compromising accuracy or speed.

Methodology 1.

Data Collection: The FER2013 dataset, consisting of 35,887 labeled images, is used for model training. The dataset covers a wide range of emotions captured from people of diverse ethnicities, age groups, and facial expressions.

2.

Model Selection: A pre-trained CNN model (VGGFace) is used for emotion classification and feature extraction. VGGFace's extensive training on large-scale datasets ensures high accuracy and adaptability.

3.

4.

Figure 2: Proposed System Architecture

Features

Implementation: The system uses the Flask framework for the backend and OpenCV for face detection. Python libraries such as NumPy and Matplotlib are used for data processing and visualization.

Real-Time Face Emotion Classification The system provides real-time analysis of facial emotions using a deep learning model. The CNN-based architecture accurately classifies seven distinct emotions, allowing instant feedback. It is particularly useful for interactive applications where understanding user emotions is essential, such as virtual assistants, video conferencing, and online learning platforms.

Prediction: DeepFace analyzes detected faces for emotion classification and age/gender prediction.

Post-processing ensures that predictions are displayed in real time on the web interface.

Age and Gender Detection The integrated age and gender detection feature offers valuable demographic insights. This data can be used for market research, customer analysis, and personalized content delivery. By using VGGFace, the model can predict

© 2025, IRJET

|

Impact Factor value: 8.315

|

ISO 9001:2008 Certified Journal

|

Page 1169

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 03 | Mar 2025

p-ISSN: 2395-0072

www.irjet.net

5. RESULTS

age within a reasonable range and classify gender effectively. This feature supports applications in retail analytics, audience profiling, and targeted marketing.

The system achieved high accuracy using transfer learning.

Real-time emotion detection was responsive with minimal latency. Further testing on diverse datasets is recommended to improve accuracy under different lighting and facial variations. Accuracy metrics such as precision, recall, and F1-score were evaluated to ensure reliable performance. Additionally, user feedback indicated high satisfaction with the system’s real-time responsiveness and accuracy.

User-Friendly Web Interface The web application is designed with an intuitive interface for a seamless user experience. Users can view real-time webcam feeds with emotion, age, and gender predictions displayed on-screen. The interface includes adjustable settings for customizing the analysis experience, including options to view detection results in various formats. Its simple and interactive layout makes it accessible for both technical and non-technical users.

Support for Multiple Face Detection The system efficiently detects and analyzes multiple faces simultaneously within a single video frame. This capability is essential for applications such as security surveillance, audience reaction analysis, and social interaction studies.

The face detection algorithm is robust enough to differentiate individual faces, even in crowded or low-light environments.

Efficient GPU-Based Processing

Figure 3: Home Page

Leveraging GPU acceleration with TensorFlow and Keras significantly enhances processing speed. The use of parallel processing ensures that predictions are delivered with minimal latency. This allows the system to maintain real-time performance, which is crucial for time-sensitive applications like video conferencing and live broadcast monitoring.

Scalable and Flexible Architecture The system is built with a scalable architecture that can be deployed on cloud platforms for large-scale applications. It can handle high input volumes from multiple camera sources, making it ideal for use in public surveillance, retail spaces, and corporate environments. The flexibility of the architecture also allows integration with other AI models for additional functionalities.

Figure 4: About Page

Adjustable Model Parameters Users can adjust model parameters such as detection confidence thresholds, emotion sensitivity, and frame processing rates. This customization ensures optimal performance based on specific use-case requirements. For example, applications in sensitive environments like healthcare may require higher accuracy, while real-time gaming applications may prioritize speed.

© 2025, IRJET

|

Impact Factor value: 8.315

Figure 5: Result

|

ISO 9001:2008 Certified Journal

|

Page 1170

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 03 | Mar 2025

p-ISSN: 2395-0072

www.irjet.net

ogdan Constantin Neagu. "Face spoofing, age, gender and facial expression recognition using advance neural network architecture-based biometric system." Sensors 22, no. 14 (2022): 5160.

6. CONCLUSION This project demonstrates the effectiveness of deep learning in facial emotion classification. It has potential applications in healthcare, customer experience enhancement, and virtual assistants. The proposed system serves as a foundation for further research and improvements in facial analysis technologies. Real-world testing and additional model fine-tuning can further enhance its performance and applicability. Integrating additional features like emotion intensity detection and personalized feedback responses can extend its use in various industries.

7. FUTURE SCOPE Enhancing the model with additional datasets, implementing edge computing for lower latency, and introducing multilingual support for wider accessibility.

Expanding emotion categories and incorporating contextual understanding using NLP techniques can also be explored. Additionally, creating a mobile application and improving cross-platform compatibility would expand user accessibility and offer broader deployment options.

[2]

[3]

[4]

Kim, Eugenia, De'Aira Bryant, Deepak Srikanth, and Ayanna Howard. "Age bias in emotion detection: An analysis of facial emotion recognition performance on young, middle-aged, and older adults." In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, pp. 638-644. 2021.

[7]

Arriaga, Octavio, Matias Valdenegro-Toro, and Paul Plöger. "Real-time convolutional neural networks for emotion and gender classification." arXiv preprint arXiv:1710.07557 (2017).

Abirami, B., T. S. Subashini, and V. Mahavaishnavi.

"Gender and age prediction from real time facial images using CNN." Materials Today: Proceedings 33 (2020): 4708-4712.

Dhwani, Mohammad Faridul Haque Siddiqui, and Ahmad Y. Javaid. "Facial emotion recognition: A survey and real-world user experiences in mixed reality." Sensors 18, no. 2 (2018): 416.

[11] Wingenbach, Tanja SH, Chris Ashwin, and Mark

Brosnan. "Sex differences in facial emotion recognition across varying expression intensity levels from videos." PLoS one 13, no. 1 (2018): e0190634.

[12] Calvo, Manuel G., Aida Gutiérrez-García, Andrés

Fernández-Martín, and Lauri Nummenmaa.

"Recognition of facial expressions of emotion is related to their frequency in everyday life."

Journal of Nonverbal Behavior 38 (2014): 549567.

Kumar, Sandeep, Shilpa Rani, Arpit Jain, Chaman Verma, Maria Simona Raboaca, Zoltán Illés, and

Impact Factor value: 8.315

Wong, Hoo Keat, and Alejandro J. Estudillo. "Face masks affect emotion categorisation, age estimation, recognition, and gender classification from faces." Cognitive research: principles and implications 7, no. 1 (2022): 91.

[10] Mehta,

González-Gualda, Luz M., Miguel A. Vicente-Querol, Arturo S. García, José P. Molina, José M. Latorre, Patricia Fernández-Sotos, and Antonio FernándezCaballero. "An exploratory study of the effect of age and gender on face scanning during affect recognition in immersive virtual reality." Scientific Reports 14, no. 1 (2024): 5553.

|

[6]

[9]

Manikandan, V. M., and Nvss Pavan Sastry. "A Smart Assistive System with Face Recognition, Emotion Detection, Age and Gender Identification." In 2024 15th International Conference on Computing Communication and Networking Technologies (ICCCNT), pp. 1-6. IEEE, 2024.

© 2025, IRJET

Uddin, Md Jashim, Paresh Chandra Barman, Khandaker Takdir Ahmed, S. A. Rahim, Abu Rumman Refat, and Md Abdullah-Al-Imran. "A convolutional neural network for real-time face detection and emotion & gender classification." SR Journal of Electronics and Communication Engineering 15, no. 3 (2020): 37-46.

[8] Noh, Soo Rim, and Derek M. Isaacowitz. "Emotional faces in context: age differences in recognition accuracy and scanning patterns." Emotion 13, no. 2 (2013): 238.

8. REFERENCES [1]

[5]

|

ISO 9001:2008 Certified Journal

|

Page 1171

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 03 | Mar 2025

p-ISSN: 2395-0072

www.irjet.net

[13] Kumar, Sandeep, Sukhwinder Singh, and Jagdish

Kumar. "A study on face recognition techniques with age and gender classification." In 2017 International Conference on Computing, Communication and Automation (ICCCA), pp.

1001-1006. IEEE, 2017.

[14] Mane,

Shraddha, and Gauri Shah. "Facial recognition, expression recognition, and gender identification." In Data Management, Analytics and Innovation: Proceedings of ICDMAI 2018, Volume 1, pp. 275-290. Springer Singapore, 2019.

[15] Dukić,

David, and Ana Sovic Krzic. "Real-time facial expression recognition using deep learning with application in the active classroom environment." Electronics 11, no. 8 (2022): 1240.

[16] Voelkle,

Manuel C., Natalie C. Ebner, Ulman Lindenberger, and Michaela Riediger. "Let me guess how old you are: effects of age, gender, and facial expression on perceptions of age."

Psychology and aging 27, no. 2 (2012): 265.

[17] Forni-Santos,

Larissa, and Flávia L. Osório.

"Influence of gender in the recognition of basic facial expressions: A critical literature review."

World Journal of Psychiatry 5, no. 3 (2015): 342.

[18] Kartali, Aneta, Miloš Roglić, Marko Barjaktarović,

Milica Đurić-Jovičić, and Milica M. Janković. "Realtime algorithms for facial emotion recognition: A comparison of different approaches." In 2018 14th Symposium on Neural Networks and Applications (NEUREL), pp. 1-4. IEEE, 2018.

[19] Dalvi, Chirag, Manish Rathod, Shruti Patil, Shilpa

Gite, and Ketan Kotecha. "A survey of ai-based facial emotion recognition: Features, ml & dl techniques, age-wise datasets and future directions." Ieee Access 9 (2021): 165806165840.

[20] Bahreini, Kiavash, Wim Van der Vegt, and Wim

Westera. "A fuzzy logic approach to reliable realtime recognition of facial emotions." Multimedia Tools and Applications 78 (2019): 18943-18966.

© 2025, IRJET

|

Impact Factor value: 8.315

|

ISO 9001:2008 Certified Journal

|

Page 1172