The Mummy is back for a third installment and Thomas J. McLean unwraps the vfx supplied by Digital Domain.
It's been seven years since adventurer Rick O'Connell last took on the evils of the ancient world in The Mummy Returns (opening today from Universal). Now back for a third entry in the series, The Mummy: Tomb of the Dragon Emperor, the film posed unique challenges to the visual effects crew at Digital Domain, which split the work on the film with Rhythm & Hues.
VFX Supervisors Joel Hynek and Matthew Butler of Digital Domain had previously worked together on xXx with director Rob Cohen, who takes over this installment of the franchise from Stephen Sommers. The film sees O'Connell, played by Brendan Fraser, and his family trying to stop Jet Li's revived Dragon Emperor and an army of terracotta warriors from conquering the world.
The first major challenge the film posed, according to Hynek, was to figure out how the terracotta warriors were going to look and move. Cohen's original idea was to create a look that Hynek described as "a liquid solid," and Digital Domain set about figuring out a way to make that happen.
"With the Dragon Emperor himself, he needs to be able to be animated to the level of seeing him deliver dialogue," adds Butler. That led to an investigation of facial movements that involved studying ways to make the face move like that of a human but also to still look like stone. The idea soon evolved to one in which the terracotta surface would crack as the warriors moved, and then be reformed in some manner.
While the physics of the destructive end was relatively simple to work out, the regeneration was not and many ideas were floated as to how it could work. "Maybe he's got something hot in the core that just fills in the gap," Butler adds.
But the results Digital Domain came up with still fell short.
"The director and the studio didn't seem to think that it was expressive enough," Butler says. They pulled back on the cracking idea and, late in the process, Cohen came up with the idea of the "under mummy." The idea was that the Dragon Emperor and his army were put into a terracotta shell, and when the exterior cracks you can see their decaying bodies underneath. This under mummy offered sufficient levels of expression, while making the terracotta warriors look tougher and suitably grotesque as the villains of the movie.
Another issue was the availability of Li, whose character appears in synthetic terracotta form for most of the movie. Butler says they always knew that "we were potentially going to be on our own" as far as having access to Li.
To ensure they had what they needed to create a terracotta version of the actor, Hynek says they used motion capture to record Li's movements and facial motions. They used a Witness camera setup, with three video cameras running in synch and in phase shooting right along with the film camera. This allowed the crew to capture very accurately the motion of Li's performance in 3D.
"It's not the first this camera has been used, but I think it is the first time they've been used in synch and in phase, which was important for getting very accurate results," Hyneck suggests. Much of this footage ended up not being used, especially after the under mummy was incorporated into the movie, and keyframe animation and motion capture of other performers was used to amp up Li's final performance.
In creating the film's 3D characters, Hynek says they primarily used Maya and Houdini for animation and Nuke -- originally a proprietary Digital Domain package but now owned by The Furnace in London -- for compositing. "We love it, because it has a 3D camera component to it that makes it very easy to incorporate 3D animation into it and you can still modify it and use a lot of the 3D aspects," Hynek says.
They also used Storm, a proprietary 3D volumetric renderer, and Track for tracking. "That came in incredibly useful here because, of course, the camera was never holding still, and we also used it then to track things on to Jet Li's face," Hynek says.
In addition to the terracotta army, the script called for a rival army of desiccated mummies called the Foundation. Butler says Massive was used to control the armies, which at times numbered near 5,000 terracotta warriors and 1,600 in the Foundation army.
Cohen, however, wanted each soldier to look different. "So our team leader had to come up with ways of having 20 different bodies and different heads," Butler says.
For the Foundation, in particular, that made the work a real challenge.
"These guys, they're decrepit but they have hair and they have clothing, of course -- all those bloody annoying things that make it very difficult for us to achieve," Butler offers.
Their look was based largely on the real thing, Hynek says. "We just used tons of reference of mummies and desiccated people," he explains. "Not so much mummies, because mummies are prepared in wraps and what not, but really more, what do people look like when they've been in the ground for a long time?"
The terracotta soldiers also had a lot of variation -- much like the real terracotta soldiers, each of which is unique and believed to have been based on a real man.
"Rob really wanted the audience to feel when they looked at a row of these terracotta soldiers that you knew who these guys were, that somehow you knew, like you do when you looked at the real guys, that you get a feeling for who they were, what their personality was like and so we tried very hard to emulate that," Hynek says.
One area of discussion involved color, as the real terracotta warriors were originally painted. "We talked with Rob about that, but he felt that people's memory, their knowledge of what the terracotta army looks like, was based on the original find in the '70s," Butler says.
Convincing audiences that it was truly Li inside the terracotta Dragon Emperor was another key point. Hynek says they originally used a scan of Li's features, but Cohen decided it looked too much like him and asked for a more stylized version.
Motion capture fine-tuned with keyframe animation was the only way to get Li's features on the under mummy in time. Hynek says the animator on this, Calvin Lee, spoke Mandarin Chinese, which was immensely helpful in getting a good lip synch for the character, who doesn't speak English in the film.
Butler says additional work included digital environments, largely to increase the scope of the final battle. That work required a lot of integration elements between the battling armies and the environment -- things like footprints and dust being kicked up.
Hynek says most of that work was done with plates shot both from the ground and from above, with occasional full CG environments.
Another restriction that lead to innovations was using very few greenscreens, the full-on use of which would have ground the production to a halt, Butler says. Instead, they used tracking and processes that emulated greenscreens to recreate the required information in post -- all of which freed up the production to shoot quickly.
"It's sort of a blessing and a tragedy," Hynek says. "The downside is that, in the future we're probably always going to be doing everything through rotoscoping."
Digital Domain did about 310 of the film's 850 vfx shots, with Rhythm & Hues doing about 350 and a handful of smaller shots handled by Pac Title, Hynek adds.
Thomas J. McLean is a freelance journalist whose articles have appeared in Variety, Below the Line, Animation Magazine and Publishers Weekly. He writes a comicbook blog for Variety.com called Bags and Boards, and is the author of Mutant Cinema: The X-Men Trilogy from Comics to Screen, forthcoming from Sequart.com Books.