ANIMATION WORLD MAGAZINE - ISSUE 5.05 - AUGUST 2000
Focus on SIGGRAPH: Eyetronics
by Juniko Moody
This year's SIGGRAPH keynote address, "The Human-Machine Merger: Why We Will Spend Most of Our Time in Virtual Reality in the 21st Century" will be given by scientist, inventor and visionary Ray Kurzweil. According to Kurzweil, by the 2020s virtual reality will no longer be the crude depiction that we see today. Instead, it will be so realistic that it will be difficult to distinguish from our material world experience.
Indeed, already neural or other implants have been used to counteract impairments caused by Parkinson's disease, multiple sclerosis, deafness, blindness and paralysis. The leap from life-assisting to life-enhancing and recreational applications no longer seems so far. Evidence for Kurzweil's reasoning can be found in Eyetronics' ShapeSnatcher demonstration. The ability to render real-life objects or people as virtual 3D objects in one hour or less surely is an essential part of Kurzweil's highly evolved machine-system scenario.
Lynn. © Eyetronics.The speed, economy and simplicity with which Eyetronics representative Nick Tesi captured the likeness of volunteer Lynn was truly amazing. Using only a slide projector, a consumer video camera with a 3.5-inch floppy output (Tesi used the SONY DCR-TRV900 three-CCD digital video camcorder), the ShapeSnatcher calibration box and ShapeSnatcher/Matcher software running on a PC, Tesi was able to render 640x480 resolution images of virtual Lynn in very little time. Because the projector and camera were already set up, it only took 15 minutes for the photography. The software processing took 45 minutes, longer than usual, because Tesi took time to explain each step.
The fact that all of these components are available to consumers and that the software is priced like any consumer electronics equipment demonstrates that high-end graphics can be achieved by anyone. Users don't need any special skills or training to produce adequate results. This technology is a vast improvement over the days when artists chose digital models by browsing through a supplier's catalog of available objects. Those objects were generic and might not be exactly what the artist needed, so modifications had to be made. With ShapeSnatcher, if the object exists, you can capture it.
The process appeared to be quite simple. Tesi positioned Lynn before the projector and "snapped" her picture with the video camera, deliberating slightly over the focus of the special ShapeSnatcher grid slide projected onto her face. After he was certain she was in focus and in full view, the rest of the process proceeded quickly. He took three pictures of Lynn -- frontal, left profile and right profile -- then a shot of the calibration box, which she held in front of her face. There were not even any special lighting requirements, since illumination came from the slide projector.
Calibration. © Eyetronics.After that, it was a short walk to the computer to download the 640x480 images from the floppy disk. The first step was to create 3D spatial coordinates by using the image of the calibration box and ShapeSnatcher. The calibration box works on given references, such as the planes being at a 90-degree angle to each other and the distances between the circles printed on the box. This information is used to calculate parameters such as camera-to-object distance and focal length. Once these parameters are established, object surface information can be deduced from the deformation of the grid projected on the object's surface.
Having established spatial references, the next step was to transform Lynn's frontal portrait into a mesh map. After some anticipatory cleanup, Tesi was ready to perform the same treatment to the left and right profiles. Hair requires a special strategy, so if the artist is not prepared for that, it is best to remove data up to the hairline. Jagged edges also should be removed, because that makes merging different mesh surfaces cleaner and easier.
Object capture is limited to the viewing angle of the camera lens, so getting a 180-degree view of a head necessitates three viewpoints. Tesi could have used a wider lens but, as any portrait photographer knows, the result is less than flattering and is not an accurate representation of the subject.
Blending the three wire-frame meshes with ShapeMatcher was surprisingly easy. In a few minutes, Tesi had the completed facial mesh map. Even the areas of overlap were seamless. The entire map was displayed as a conforming, rectangular grid, even in the highly detailed areas such as the mouth, nose and eyes.
1 | 2 ![]()
Note: Readers may contact any Animation World Magazine contributor by sending an e-mail to editor@awn.com.
Table of Contents
Feedback?
Past Issues
Animation World Magazine
Career Connections | School Database | Student Corner
Animation World Store | Animation Village | Calendar of Events
The AWN Gallery | The AWN Vault | Forums & Chats
Home
About | Help | Home | info@awn.com | Mail | Register
![]()
©2000 Animation World Network