New Sony patent uses generative AI to tweak game difficulty based on emotions

Developers often struggle to find difficulty settings that challenge every player. Some gamers may discover that their play style fits a title, allowing them to breeze through a campaign. To adapt to these tendencies more intelligently, a Sony patent turns to generative AI. The technology would also monitor emotions to balance between enjoyment and frustration.

AI aims to provide a consistent challenge

Cheat Happens reported on a new filing, called “User Defined Level Generation.” The concept builds on another patent that employed algorithms to evaluate performance and adjust difficulty accordingly. The document explains:

If the gamer is having only a modicum of success or is experiencing difficulty, the game remains tailored to the gamer's habits and characteristics. Once the gamer achieves success, the game level may move away from the gamer's strengths to pose more challenge to the gamer.

However, in this case, generative AI tools could reprogram entire levels to offer a suitable test. If a stealth approach avoids danger, a game may add or reposition enemies to force more interactions. In the reverse scenario, overly aggressive players may find limited resources hampering their shooting sprees.

The objective of the Sony patent is not to punish talented gamers, but to keep them engaged. When a game becomes a burden, any changes can be reversed. In a crowded PlayStation Store, players may be quicker to abandon a title that’s too easy or too hard.

How feelings can dictate game difficulty

In addition to watching gameplay, the technology also observes emotions to maintain a consistent fun factor. Still, how it detects happiness, anger, or boredom and sends that data to the AI tools may raise red flags.

The filing suggests a long list of potential sensors for recognizing mood shifts. Some of these options, like microphones and motion sensors, are already found in the PS5 DualSense controller. Other means rely on gear not frequently connected to the console, like cameras.

Besides privacy concerns, it’s unclear how well this monitoring would work on stoic subjects. Ideally, as the technology advances, it will pick up on the most subtle behavioral signals.

Sony patents have proposed a number of unique applications for generative AI to benefit gamers, some more realistic than others. Even so, there is a push to move past the era of easy, medium, and hard difficulty settings.