Depth Image Based Compositing for Stereo 3D

 

We investigate new methods for compositing live action stereo 3D, given two stereo camera systems and a corresponding depth map.

October 15, 2012
3D Television Conference (3DTV-CON) 2012

 

Authors

Lars Schnyder (Disney Research)

Manuel Lang (Disney Research/ETH Joint PhD)

Oliver Wang (Disney Research)

Aljoscha Smolic (Disney Research)

Depth Image Based Compositing for Stereo 3D

Download Publication PDF

Abstract

Compositing is an essential tool in modern film making. Established workflows exist for single-view video compositing. However, new problems that demand new solutions arise when considering stereoscopic compositing. We investigate new methods for compositing live action stereo 3D, given two stereo camera systems and a corresponding depth map. We break the process up into three main steps; First, we show how to use trifocal tensors to robustly project 3D content from one video into another. Second, we analyze different image-based rendering methods for drawing objects to be composited into the new video. Finally, we describe a novel super-pixel based depth-test that increases robustness to errors in depth map accuracy. A user study was conducted to validate different steps of this process.

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.

 

 
Research at Disney

 

 

 

 

 

 

 

 

Legal
MORE