Capturing Every Emotion

Depiction of the pre-processing adapted by the research work

An In-depth Facial Expression Study Using Multimodal Sentiment Analysis and Facial Emotion Recognition of Real-Time Video Using Neural Networks.

The project attempts to build a robust and efficient analytical study on human facial behavior by analyzing how the human face functions during a conversation and researching ways to find a correlation between what people say and the facial expressions they make when saying it. This research aims to help boost the accuracy of sentiment prediction by also analyzing the facial features along with the person’s speech transcriptions.

It has two parts:

  • Multimodal Sentiment Analysis(Video + Text)

  • Real Time Emotion Recognition

Niraj Yagnik
Niraj Yagnik
Computer Science Grad Student and Researcher

My research interests include but are not limited to Recommendation Systems, Natural Language Processing, Machine Learning, and Social Computing.