Mobile App for Therapy (2023 Spring)

Project Overview

Developed a real-time, multimodal, and multi-language emotion recognition app using DeepFace, SpeechRecognition, and revChatGPT as part of a course project at Carnegie Mellon University (January 2023 - May 2023). The application was deployed on Streamlit Cloud, enabling emotion recognition through facial expressions and speech analysis in multiple languages.

Key Features

  • Real-Time Emotion Recognition: Utilized DeepFace and SpeechRecognition to recognize emotions from video and audio inputs.
  • Multimodal & Multi-Language: Combined facial expression and speech analysis with revChatGPT for emotion detection in multiple languages.
  • Streamlit Cloud Deployment: Deployed the app on Streamlit Cloud, allowing for easy access and real-time processing.
View on GitHub Watch 2-Minute Demo View Presentation Read Report