Emotion Classification using Tensorflow.js

Classify the emotion in real time and play music according to the emotion

This is a real-time Emotion detection using TensorFlow.js to load a pretrained model into the browser .

Abstract

Detect faces

• We use two methods to detect faces:

  1. Chrome Shape Detection API
  2. face-api.js

Dataset

• We combine two datasets:
  1. Microsoft FERPlus as one of the dataset to train the emotion-detect model.
  2. Real-world Affective Faces Database (RAF-DB) as another dataset.

Convert Model

• Use TensorFlow.js converter convert Keras model to .json file for loading and running Javascript inference.

Requirements

• For MobileNetWebcam.html:

  Chrome Shape Detection API : FaceDetector: Chrome on Android, macOS, Windows 10 platfrom. Go to chrome browser chrome://flags/#enable-experimental-web-platform-features and enable the feature