AR Costumes: Automatically Augmenting Watertight Costumes from a single RGB Image

 

We present a practical solution to these artifacts which requires minimal costume parameterization work, and a straightforward inpainting approach.

Ocotber 30, 2018
International Conference on Intelligent Virtual Agents (IVA) 2018

 

Authors

Christoph Maurhofer (DRZ/ETH Joint M.Sc.)

Gokçen Çimen (DRZ/ETH Joint PhD)

Mattia Ryffel (Disney Research)

Robert W. Sumner (Disney Research)

Martin Guay (Disney Research)

AR Costumes: Automatically Augmenting Watertight Costumes from a single RGB Image

Abstract

We describe a method to automatically augment a watertight digital costume onto a person’s body from a monocular RGB image. When overlaying a digital costume onto a body using pose matching, several parts of the person’s cloth or skin remain visible to due to differences in shape and proportions. In this paper, we present a practical solution to these artifacts which requires minimal costume parameterization work, and a straightforward inpainting approach. To our knowledge, our approach is the first to deliver plausible watertight costumes from RGB imagery only, and is compatible with mobile devices.

Copyright Notice