Emotion Classification using Tensorflow.js

Classify the emotion in real time and play music according to the emotion

This is a real-time Emotion detection using TensorFlow.js to load a pretrained model into the browser .

Abstract

Detect faces

We use two methods to detect faces:
1. Chrome Shape Detection API
2. face-api.js

Dataset

We combine two datasets:
1. Microsoft FERPlus as one of the dataset to train the emotion-detect model.
2. Real-world Affective Faces Database (RAF-DB) as another dataset.

Convert Model

Use TensorFlow.js converter convert Keras model to .json file for loading and running Javascript inference.

Requirements

For MobileNetWebcam.html:

Chrome Shape Detection API : FaceDetector: Chrome on Android, macOS, Windows 10 platfrom. Go to chrome browser chrome://flags/#enable-experimental-web-platform-features and enable the feature