'The Winston Show' Launches a New Era of Real-time Interactive Entertainment
Several years ago, business partners Oren Jacob and Martin Reddy came up with an idea to use speech recognition to drive character-based interactive entertainment, starting a company, ToyTalk, to develop needed interactive tools and technology. Enter Bobby Podesta. Having left Pixar after 14 years, most recently as a supervising animator on Toy Story 3, he was looking for new challenges in storytelling and entertainment development. After meeting Oren and Martin, he became enthralled with their working prototype, and immediately saw great potential for their new interactive entertainment engine. Podesta joined ToyTalk soon thereafter and set about directing their first show. With $16 million in venture capital and a top team of creative types, ToyTalk just last week launched The Winston Show, their first commercial entertainment application release. The app is now available free of charge through the Apple App Store.
Available for free on the iPad and geared for kids 5-10, The Winston Show is an interactive conversation-driven talk show that moves across topics and activities in real-time based upon the user’s verbal input. Speech recognition and artificial intelligence drive the two main characters, Winston and his sidekick Ellington, around their CG set and the various activities at their disposal, all based on the unique interaction with the user.
According to Podesta, the goal has always been to make animated characters that interacted in real-time with their audience. “The iPad isn’t just a one-way experience like a TV. It’s a two-way communication device. Built in camera, microphone, internet connection. As an animator, what could be more rewarding than creating characters that interact with and entertain you right then and there as you talk to them in real-time?”
The app contains no pre-rendered animation. Everything is done dynamically on the fly. To make this happen, ToyTalk built their own proprietary technology called PullString, which integrates dialogue with sketches, artwork and animation for two-way AI-driven conversations. It’s a sophisticated authoring tool that triggers animation, sound effects and other character behaviors. It is even designed to handle subtleties in the interaction, such as defining how the characters react to being ignored, or when a user changes the subject. But at its core, the technology enables creativity by allowing artists to develop shows like The Winston Show without deep technical or programming knowledge. Real-time interactive conversations with animated characters opens up a whole world or possibilities. The underlying technology they’ve developed provides another creative tool for artists to work with.
With six hours of content available in the initial app, pre-rendered animation wasn’t an option. Instead, the system sends out information to drive the animation in the form of splines, which feed CG models within the device, providing a real-time animated experience. Models and environments are animated in Maya and other digital tools.