Introduction to AI-Powered PlayStation Characters

Sony has successfully utilized artificial intelligence to enable a PlayStation character to engage in conversations with a player, as reported by The Verge. A source shared a video, which has since been deleted, featuring an AI-powered version of Aloy from Horizon Forbidden West with the publication. Engadget had the opportunity to view the video before it was taken down.

AI-Powered Conversation Demo

In the demo, Aloy is capable of holding conversations with voice prompts during gameplay and responding to questions with a synthesized voice and facial movements. The conversation begins with Aloy responding to a question about her well-being, stating that she is "managing alright, just dealing with a sore throat," which seems like an unusual remark. The technology appears to function seamlessly within both a controlled demo and the entirety of the Horizon Forbidden West game. During gameplay, Aloy answers questions about her location and the time, although she only mentions it’s afternoon and hot, rather than providing a specific time. After the game, Aloy returns to interview mode and provides an overview of what just transpired.

Eerie Robotic Voice

The unsettling part, at least to some, occurs when Aloy is prompted to bid farewell to the audience and express gratitude. Although the character complies, the robotic voice creates an eerie atmosphere.

Technologies Used

To create this prototype, Sony employed several models, including GPT-4 and Llama 3, which power decision-making and conversation, as well as OpenAI’s Whisper for speech-to-text functionality. According to the demo, Sony utilized its own Emotional Voice Synthesis (EVS) system and Mockingbird technology for speech generation and audio-to-face animation, two technologies that the company has not publicly discussed extensively.

Similar Technologies

NVIDIA and Microsoft have been working on similar technologies. NVIDIA has used ACE, its suite of technology for enlivening game characters with AI, to create AI-powered conversations for NPCs. However, Engadget’s senior editor, Devindra Hardawar, was unimpressed, stating in January that "seeing several NVIDIA ACE demos back-to-back made me genuinely sick to my stomach."