Leaked Internal Sony Video Uses Horizon's Aloy to Show AI-Powered PlayStation Character Prototype

A leaked internal Sony video reveals ongoing experiments with AI-powered PlayStation characters. The Verge reported on a video, allegedly from PlayStation Studios' advanced technology group, showcasing AI-powered Aloy from the Horizon games. The video's subsequent removal from YouTube following a copyright claim from Muso (a company listing Sony Interactive Entertainment as a client) suggests its authenticity. IGN has reached out to Sony for comment.

The video, as described by The Verge, features Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, conversing with an AI-powered Aloy. The technology utilizes OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) for speech, and Sony's Mockingbird technology for facial animation.

The conversation, while technically impressive, reveals limitations. Aloy's voice lacks the familiar tone of Ashly Burch, instead employing a robotic text-to-speech quality. Her facial animations are stiff, and her eyes appear lifeless. Despite these limitations, the AI accurately responds to prompts about her backstory, including her discovery of being a clone of Dr. Elizabeth Sobeck.

The demo seamlessly transitions into the Horizon Forbidden West game world, allowing Raghoebardajal to continue the conversation while playing. The juxtaposition of interacting with a character the player controls highlights the technology's novelty and raises questions about its potential impact on gameplay. The irony of using Aloy, given the themes of the Horizon games, is also apparent.

The prototype, developed with Guerrilla Games, serves as an internal demonstration of the technology's capabilities. While Sony hasn't confirmed plans for public implementation, the video indicates a significant investment in AI-powered characters. This isn't surprising, given the industry-wide exploration of AI technology by competitors like Microsoft (with its Muse AI) and others.

The use of generative AI in gaming remains a complex issue, facing criticism regarding ethical concerns, rights issues, and the technology's current limitations in creating consistently enjoyable content. Keywords Studios' failed experiment with an entirely AI-generated game underscores these challenges. Despite this, companies like EA and Capcom are actively exploring generative AI's potential, highlighting its growing importance within the industry.

Asad Qizilbash, Head of PlayStation Productions and Head of Product at PlayStation Studios, emphasized the importance of AI in gaming for younger generations (Gen Z and Gen Alpha) seeking personalized experiences. He cited the potential for AI-driven NPCs to interact dynamically with players based on their actions, enhancing engagement.

Activision's recent admission of using generative AI for some Call of Duty: Black Ops 6 assets, amidst criticism of AI-generated content, further illustrates the ongoing debate surrounding the technology's role in game development.

### What's The Best PlayStation 5 Game?

### Pick a winner