The Anyma Performance Capture system, developed by Disney Research in Zurich, is a flexible solution for unconstrained, markerless facial performance capture. Anyma allows the actor freedom to move around, and still produces dense, consistent facial reconstruction at the quality of Medusa. The underlying actor model is built from a small number of Medusa reconstructions.
Anyma can be operated in several scenarios, ranging from a studio setup with an ADR-style booth, to on-set reconstruction with helmet-mounted cameras (HMCs). The flexibility of Anyma allows to operate from as little as one single camera, to many cameras placed around the scene.
Anyma delivers high quality, dense, facial geometry accurately tracked over time, as well as per-frame tracked skull positions that represent the rigid head motion of the actor, removing the need to estimate the head pose or HMC stabilization manually.
The video on the right shows a production test of Anyma in action. Here we see the ADR-booth scenario, where 3 film cameras observe the actor from a distance. The video is illustrated in slow motion.
The top row shows the video plates, with the reconstructed face overlaid in blue. The bottom right shows a virtual texture mapped to the actor’s face, demonstrating the accuracy of the tracking. Since the skull is also tracked automatically, we can remove the rigid head motion and show only the expression deformation in the stabilized view in bottom left.
With special thanks to:
The Anyma Performance Capture System is based on the following main research project, and is continually improved through ongoing research and technical innovation.
July 11, 2016
ACM SIGGRAPH 2016
Chenglei Wu (ETH Zurich) Derek Bradley (Disney Research) Markus Gross (Disney Research/ETH Zurich) Thabo Beeler (Disney Research)
For more information on the Anyma technology, please contact firstname.lastname@example.org