My teammates Anthony and Jacob Emmel and I worked on this project in Hack the North 2016–Canada’s biggest hackathon! This is a system that can recognize human facial expression and analyze emotions (i.e: happy, sad, angry…) using CV and Machine Learning. After that, the human emotion data is streamed to a Unity character which is projected on a DIY pyramid hologram.
- Github repository: https://github.com/megatran/EmotionRecognitionOnHologram
Building & Running
- Unity Personal Edition (developed with v5.4)
- Python 2.7
All Python dependencies can be installed with pip:
pip install requests numpy scikit-learn matplotlib h5py keras
A windowed executable for the Unity project (including the web server) can be created through File > Build & Run. The project can also be run by clicking the play button in the upper middle part of the Unity screen.
The Python script, which takes input through the webcam and sends emotion information to the backend service, can be run with the following (from the current directory):