Imagine putting on a virtual reality (VR) headset, walking into a glowing nightclub, and being greeted by someone who smiles and says, “Hey, you look so cute!”
As you smile back, the headset notices your facial expression and recognizes that you are genuinely happy.
Instead of simply watching a story unfold, your real emotions become part of the experience.
This is the idea behind Rekindle, a new VR game created by researchers at Northeastern University.
The game combines storytelling with emotion-tracking technology to help players better understand the experiences of LGBTQ+ people. The researchers hope it can encourage empathy and create positive social change.
The story takes place in a future where an oppressive government has erased people’s memories of sexual identity if it considers those identities unacceptable. Players take on the role of a character trying to recover these lost memories one by one.
As players explore the world, they collect memory fragments that move the story forward. Unlike coins or points collected in many video games, these memories represent meaningful moments connected to LGBTQ+ experiences.
Some reflect joyful events, while others are inspired by painful moments in history, including the 2016 Pulse nightclub shooting in Orlando, where 49 people were killed in an attack targeting the LGBTQ+ community.
What makes Rekindle different from most VR games is that it reacts to the player’s real emotions. The Samsung Galaxy XR headset tracks tiny movements in the face, including the eyes, eyebrows and mouth.
It measures dozens of facial muscle movements and uses them to estimate emotions such as happiness, sadness, surprise, anger or fear. It can even detect mixed emotions, such as being happily surprised or sadly angry.
The game sometimes asks players to express certain emotions before they can continue the story. Rather than simply pressing buttons, players become active participants whose feelings help shape the experience.
The researchers say this creates a stronger emotional connection with the main character and encourages players to see the world through someone else’s eyes.
According to the team, many games already collect information about what players do, such as where they click or how they move. Rekindle goes further by trying to understand how players feel during important moments in the story.
Not everyone will react in the same way. Someone who is part of the LGBTQ+ community may experience certain scenes very differently from someone with little knowledge of LGBTQ+ history. The researchers believe these different emotional responses are valuable because they encourage players to reflect on their own feelings and possible biases.
The team also sees many possible uses for this technology beyond gaming. Emotion-tracking VR could improve mental health treatments, such as virtual therapy for people with anxiety, phobias or post-traumatic stress disorder (PTSD).
Instead of relying only on what patients say, therapists could also understand how they are feeling by monitoring their facial expressions.
Researchers also believe emotion-aware technology could improve road safety by detecting when drivers are becoming tired or stressed. Similar systems might one day guide people through stressful situations by recognizing signs of fear or anxiety and offering calming support.
Although Rekindle is still an experimental project, it shows how combining virtual reality, storytelling and emotion tracking could create more personal, meaningful experiences that help people better understand the lives of others.
