Sony had already promised that the PS5 would revolutionize gaming sound with its integrated 3D audio processing unit. Now, it looks like Sony's next step is to develop AI-based game soundtracks that react to your gameplay or emotions and change the music accordingly. The ``Dynamic Music Creation in Gaming'' patent was first discovered by Game Rant, and while it doesn't mention the PlayStation 5 specifically, it has all the makings of a feature Sony is considering for the next console. In the patent, Sony engineers describe how they plan to use machine learning to analyze how different 'musical components' such as rhythm, melody and harmony correspond to specific emotions, and then create different emotionally variant musical scores that will elicit feelings. specific to the players while they play. First, Sony will ask its composers to create musical "patterns" that correspond to a specific character, in-game activity, locations, or even the "personality" of the player. These patterns will then be coded to play based on data from Sony about what the player is feeling or should be feeling at any given moment. For example, on the PS5, Sony could take music from the entire world of Assassin's Creed Valhalla and lower the tempo and percussion for a calmer environment if the player has stopped moving for a while, increasing the tension if they're locked on to a target. , or add a moving violin if a beloved character appears. The specific emotions that this dynamic system would attempt to evoke include tension, power, joy, wonder, tenderness, transcendence, tranquility, nostalgia, sadness, sensuality, and fear. The engineers plan to analyze tons of popular music to turn music that causes emotions into science. Its machine learning system will convert the music into electronic sheet music, compare the scores with reviews from critics and fans, and then time-mark specific pieces of music that match specific emotions. Sony then plans to experiment with "matching emotions and scenarios." During a stressful time, rather than playing tense music in predictable ways, they argued that an undercurrent of underlying sensuality might have a "better and more interesting effect" on your experience. Although we do not know when the "compositing engine" will be considered viable, it is certain that it could work on the PS5 by the end of 2020 to differentiate the console from the Xbox Series X. Many video games today already adjust their music based on actions or in-game player events, but not with this level of subtlety and customization.
Sony's biometric future for PS5?
cámara térmica o infrarroja '', un wearable activity tracker'' or a ''bio-sensing smartwatch'' From there, the system will take data from your body and adjust the soundtrack accordingly. Imagine if you died multiple times in front of a tough boss, and the PS5 could detect your high heart rate, interpret that as frustration, and adjust the soundtrack to play something more relaxing. Many PS5 owners won't be comfortable with Sony knowing so much about their health and personality. But if Sony's machine learning can profile a subset of gamers, they can probably predict average emotional responses to certain segments of the game. Then they can extrapolate how any player might react to a scene. given and adjust the music accordingly. Regardless of privacy concerns, this patent suggests that Sony may be interested in monitoring player health in other contexts. Nintendo has been exploring sleep tracking technology for years, and its Ring Fit Adventure exercise game has been a huge success. Sony may have similar aspirations for the PlayStation 5, either to create its own tracking technology or to connect gamers' smartwatches and fitness trackers to the PS5 to provide real-time data.