Fully Connected Object Proposals For Video Segmentation


We present a novel approach to video segmentation using multiple object proposals.

December 11, 2015
International Conference on Computer Vision (ICCV) 2015



Federico Perazzi (Disney Research/ETH Zurich)

Oliver Wang (Disney Research)

Markus Gross (Disney Research/ETH Zürich)

Alexander Sorkine-Hornung (Disney Research)

Fully Connected Object Proposals For Video Segmentation


The problem is formulated as a minimization of a novel energy function defined over a fully connected graph of object proposals. Our model combines appearance with long-range point tracks, which is key to ensure robustness with respect to fast motion and occlusions over longer video sequences. As opposed to previous approaches based on object proposals, we do not seek the best per-frame object hypotheses to perform the segmentation. Instead, we combine multiple, potentially imperfect proposals to improve overall segmentation accuracy and ensure robustness to outliers. Overall, the basic algorithm consists of three steps. First, we generate a very large number of object proposals for each video frame using existing techniques. Next, we perform an SVM-based pruning step to retain only high quality proposals with sufficiently discriminative power. Finally, we determine the fore- and background classification by solving for the maximum a posteriori of a fully connected conditional random field, defined using our novel energy function. Experimental results on a well established dataset demonstrate that our method compares favorably to several recent state-of-the-art approaches.

Copyright Notice