NVIDIA Collaborates With Weta to Accelerate Visual Effects for Avatar
Press Release from NVIDIA
Avatar, the breakthrough stereoscopic 3-D feature film from James Cameron and Twentieth Century Fox opened on December 18, 2009 with a record breaking opening weekend of over $77 million for any 3-D movie, and grossing over $1 billion worldwide since then. The film features lushly detailed scenes and an extensive cast of virtual characters set in computer generated (CG) environments.
Wellington, NZ-based Weta Digital, the primary visual effects vendor on the film, is a longtime NVIDIA customer and deploys both Quadro professional graphics solutions and Tesla high performance computing solutions in its visual effects (VFX) production pipeline.
Weta was tasked with building sequences with as many as 800 fully CG characters in highly stylized digital settings. The computational power required to process the /Avatar/ shots was higher than that required by any project Weta had faced to date, so they turned to NVIDIA, the inventor of the graphics processing unit (GPU).
“The complexity of Avatar motivated us to think about rendering differently,” explained Sebastian Sylwan, Weta’s head of research and development. “We do our final beauty-pass renders with RenderMan, but to optimize artistic iterations on Avatar’s huge data sets, we moved the bulk of the calculation to a pre-computation step. The issues we needed to solve weren’t as much about rendering as they were about high-performance computing, and we realized that using the massively parallel power of a GPU to solve problems is NVIDIA’s expertise.”
In March of 2009, Weta rendering research lead Luca Fascione, Weta CTO Paul Ryan and Jacopo Pantaleoni, an NVIDIA Research senior architect, discussed what Weta was up against. “Paul let me know that for the first time in the history of CG visual effects, the number of polygons required was going to be measured in billions rather than in millions,” said Pantaleoni. “Luca described their unique approach to lighting, and their need for a scalable solution to ray trace the entire, amazingly complex world they were about to create.”
Weta R&D and NVIDIA Research began their collaboration, with Pantaleoni traveling to New Zealand and residing there for several months to start development on a ray-tracing software solution that could handle the billions of polygons required in Avatar’s complex sequences.
Together, NVIDIA and Weta co-developed a new pre-computation engine, dubbed PantaRay, to bring high-performance computing power into Weta’s VFX pipeline. The name PantaRay is a clever twist on a Greek aphorism "panta rhei” which means “everything flows”. This powerful ray-tracing system was designed specifically to accelerate pre-computation of scene occlusion information used throughout Weta’s rendering pipeline, to allow quick and dynamic re-computation of image-based lighting.
The innovative approach enabled Weta to render more complex scenes in less time, while using less memory and fewer processors. The result gave artists the critical ability to iterate faster and make more changes, ultimately achieving higher quality photorealistic results. With NVIDIA’s co-development efforts, Weta was able to generate scenes that previously would have been time and cost prohibitive.
The benefits Weta achieved with the solution co-developed by NVIDIA Research’s Pantaleoni compelled them to further embrace GPU computing – the power of NVIDIA technology to perform massively parallel computing. NVIDIA ported Weta’s PantaRay engine to a CUDA-based GPU driven version that runs 25 times faster, utilizing an NVIDIA Tesla S1070 GPU-based server instead of a CPU based server.