AR Museum: A Mobile Augmented Reality Application for Interactive Painting Recoloring

 

We propose the use of a fully automatic soft color segmentation algorithm for content generation for such an augmented reality application.

August 23, 2017
Multi Conference on Computer Science and Information Systems 2017

 

Authors

Mattia Ryffel (Disney Research)

Fabio Zünd (Disney Research/ETH Joint PhD)

Yagiz Aksoy (Disney Research/ETH Joint PhD)

Alessia Marra (Disney Research)

Maurizio Nitti (Disney Research)

Tunc Aydin (Disney Research)

Robert W. Sumner (Disney Research)

AR Museum: A Mobile Augmented Reality Application for Interactive Painting Recoloring

Abstract

We present a mobile augmented reality application that allows its users to modify colors of paintings via simple touch interactions. Our method is intended for museums and art exhibitions and aims to provide an entertaining way for interacting with paintings in a non-intrusive manner. Plausible color edits are achieved by utilizing a set of layers with corresponding alpha channels, which needs to be generated for each individual painting in a pre-processing step. Manually performing such a layer decomposition is a tedious process and makes the entire system infeasible for most practical use cases. In this work, we propose the use of a fully automatic soft color segmentation algorithm for content generation for such an augmented reality application. This way, we significantly reduce the amount of manual labor needed for deploying our system and thus make our system feasible for real-world use.

Copyright Notice