Sony Patents AI System for Video Game Assets

Sony Patents AI System for Video Game Assets

Key Takeaways

  • Sony patents AI for game asset creation to enhance customization for content creators or developers.
  • The technology allows people to modify scenes using voice commands, though it’s not clear if this will be accessible to players
  • Sony is leading in patenting AI systems for integration in games, but competitors are expected to follow suit.

As a seasoned gamer with decades of experience under my belt, I must say that the latest developments in AI-based game asset creation by Sony have me both exhilarated and a little overwhelmed. With each new patent, it feels like we’re stepping into an era where the boundaries between content creator and player are becoming increasingly blurred.


A recently disclosed patent unveils Sony’s strategy for enabling game developers to utilize artificial intelligence (AI) in generating game assets. This innovation stands out, given that leading video game corporations are eagerly incorporating AI into their offerings, and Sony is making a strong move towards the front by frequently patenting novel AI technologies.

Beginning from 2023, the company has secured several significant patents for AI-driven technologies. For instance, a recent patent by Sony allows AI to engage with games and broadcast the gameplay. Another patent proposes developing AI companions that adapt according to player actions, enhancing gaming immersion and personalization. Currently, it seems that Sony is taking AI innovation a step further, investigating ways to transform players into designers of in-game assets.

According to a recently unveiled Sony patent, a new technology is proposed that transforms spoken words into 3D models, which can subsequently be tailored and integrated into video games. The emphasis on building “sub-parts” implies the system is primarily designed for customizing game background elements. For instance, the patent mentions a scenario where a user designs and alters an AI-generated chair, then incorporates it into a gaming scene.

Sony’s New AI Could Let Players Customize Objects in Games

This innovative patent for asset generation in video games might significantly change how gamers engage with virtual worlds. The technology seems designed to empower content creators and developers to modify scenes using spoken commands, thereby crafting unique game settings and character appearances. This could involve remodeling entire scenes or creating bespoke accessories for in-game characters. While the patent doesn’t explicitly say whether this system will be accessible to players, considering Sony’s recent patent for an AI-based avatar generation system, it’s reasonable to assume that they aim to broaden customization possibilities for gamers.

How Sony’s AI-Based Asset Generation Works

  • The user provides a voice input.
  • The AI processes the input, converts it to text, and creates a corresponding 2D model.
  • The 2D model is then transformed into a 3D model using a conversion algorithm.
  • The user can modify the generated asset using image examples or voice commands.
  • The final asset can be incorporated into the game.

The integration of artificial intelligence (AI) in video games is predicted to surge by 27% between 2020 and 2027, prompting even more industry titans to strive for the most profitable aspects. At present, Sony holds a significant lead with numerous innovative AI technologies that have been legally protected. Nevertheless, contenders such as Microsoft are anticipated to join the fray imminently. In the year 2022, amidst a peak in AI enthusiasm, Microsoft secured a patent for an AI-generated audio score system designed to create custom in-game soundtracks, suggesting they aim to challenge Sony’s dominance in this area.

Read More

2024-10-15 10:34