Weatherify Emotions
Interactive Weather Play to Lift Your Mood
After detecting your current emotional state, the app gives you the option to interact with the weather icon displayed on your screen. You can choose to engage in fun, weather-themed games designed to help improve your mood. Whether it's to brighten your day when you're feeling down or to enhance your joy when you're happy, these interactive experiences offer a playful way to manage and uplift your emotions.
Face-Driven Gameplay for Emotional Engagement
After detecting your current emotional state, the app gives you the option to interact with the weather icon displayed on your screen. You can choose to engage in fun, weather-themed games designed to help improve your mood. Whether it's to brighten your day when you're feeling down or to enhance your joy when you're happy, these interactive experiences offer a playful way to manage and uplift your emotions.
Catch the Elements: A Fun Way to Score with Your Emotions
Once the game begins, you'll use your basket to catch a variety of falling icons and items from above. These symbols represent weather elements like the sun, moon, lightning, snowflakes, and stars, as well as state-based messages. By moving the basket—either with facial movements or expressions—you can collect these items and earn points. The more you catch, the higher your score, making it an enjoyable and interactive way to engage with both your emotions and the game.
Positive Feedback and Encouragement for a Happier Day
At the end of the game, the system provides feedback based on your score—reflecting the number of items you've successfully caught. Through encouraging messages, the app will guide you by highlighting all the joyful moments you've engaged with, reassuring you that happiness is within reach. This positive reinforcement aims to uplift your mood, encouraging you to embrace a better, happier day ahead.
Detect Function
The app continuously tUse the camera to capture the face, extract the position of the five features in the data captured by the face, and conduct a recognition and analysis of the expression
Detect Platform
The following platforms python and P5 have been tested. These platforms use them to convert the camera information obtained into RGB information and transmit it to the analysis end for facial expression recognition
Detect Algorithm
At present, the algorithm is applicable to trained large models for face recognition, such as ML 5, venv environment and teachable machine for general recognition using large language models
P5JS
Since the faceApi feature in ml5.js is deprecated and no longer maintained, I have to change a solution, The teachable Machine
Teachable Machine
Finally, I used the teachable machine to teach the AI to recognize different expressions that I had pre-trained and then ported its code to p5. For the OUTCOMES, I got 7 different states and expressions
teration
