Ubisoft and MiHoYo Pioneer Lifelike In-Game Conversations with Nvidia’s Avatar Cloud Engine and AI

Gaming giants Ubisoft and MiHoYo are at the forefront of innovation, adopting Nvidia's Avatar Cloud Engine (ACE) to redefine the creation of video game characters. ACE utilizes speech recognition and large language models, creating lifelike in-game characters that dynamically interact with players.

A recent CES 2024 demonstration showcased ACE's potential, featuring AI-generated NPCs pondering their existence before engaging in direct conversation with a human demonstrator. This collaboration between Nvidia and Convai, specializing in conversational AI, highlights the technology's immersive capabilities.

Major players like Tencent and NetEase from China are also exploring ACE's potential, as it operates on "safe and secure data," supports engines like Unreal Engine 5, and can run in real-time through the cloud or offline on local hardware.

Despite initial ambivalence, the gaming industry anticipates a significant leap forward in AI efficiency in 2024, according to OpenAI CEO Sam Altman. However, concerns persist among creative professionals about potential job redundancy and plagiarism.

The impact of AI extends beyond gaming, with The Writers Guild of America and The Screen Actors Guild securing protections in 2023 negotiations with Hollywood studios.