Procams
Disney Research developed a set of tools for geometric and colorimetric calibration of multi-projector systems that enables Imagineers to design and build world-class projection mapping systems, as well as to maintain the attraction and ensure its quality for years of operation.
Abstract:
We are using the combination of cameras and projectors to develop a general purpose procams-framework which supports all kinds of projection mapping applications being relevant for The Walt Disney Company. These tools need to work regardless of what hardware or software was being used and regardless of the geometry of the scene being augmented. In addition to a fully automatic calibration support to estimate the projectors’ orientation and lens properties as well as overlapping areas, shadow casts, reflected color intensities and other relevant information. the developed toolbox offers functionality which is used to support designing projector-based installations.
Besides the development of production ready calibration tools, Disney Research also focused on the development of novel algorithms to augment human faces using projectors, to compensate surface texture on a sub-pixel accurate level, and to computationally design optimized surface structures to further improve the perceived quality of projection displays.
Tech Transfer:
The developed projection mapping tools have become an essential part of Walt Disney Imagineering’s (WDI) core calibration and deployment framework which is used for many of Disney’s theme park and cruise ship attractions. The results can be experienced in rides such as Soarin, Ratatouille, Tron, Journey Grotto, Pirates of the Caribbean – Battle for the Sunken Treasure, Seven Dwarfs Mine Train, Elsa, Goofy’s Paint‘n’Play, and Frozen, A Musical Spectacular just to name some of them.
Publication Highlights
Paxel: A Generic Framework to Superimpose High-Frequency Print Patterns using Projected Light
April 6, 2018
IEEE Transactions on Image Processing 2018
Petar Pjanic (Disney Research) Anselm Grundhöfer (Disney Research)
Robust Geometric Self-Calibration of Generic Multi-Projector Camera Systems
October 9, 2017
IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2017
Simon Willi (Disney Research) Anselm Grundhöfer (Disney Research)
Geometric and Photometric Consistency in a Mixed Video and Galvanoscopic Scanning Laser Projection Mapping System
August 11, 2017
IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2017
Petar Pjanic (Disney Research) Simon Willi (Disney Research) Anselm Grundhöfer (Disney Research)
A Practical Method for Fully Automatic Intrinsic Camera Calibration Using Directionally Encoded Light
July 22, 2017
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017
Mahdi Tehrani (University of California, Irvine) Thabo Beeler (Disney Research) Anselm Grundhöfer (Disney Research)
Makeup Lamps: Live Augmentation of Human Faces via Projection
April 24, 2017
Eurographics 2017
Amit Bermano (Disney Research/Princeton University) Markus Billeter (Chalmers University) Daisuke Iwai (Osaka University) Anselm Grundhöfer (Disney Research)
Spatio-Temporal Point Path Analysis and Optimization of a Galvanoscopic Scanning Laser Projector
October 1, 2016
IEEE Transactions on Visualization and Computer Graphics ( Volume: 22, Issue: 11, Nov. 2016 )
Simon Willi (Disney Research) Anselm Grundhöfer (Disney Research)
Computational Thermoforming
July 11, 2016
ACM SIGGRAPH 2016
Christian Schüller (ETH Zurich) Daniele Panozzo (ETH Zurich) Anselm Grundhöfer (Disney Research) Henning Zimmer (Disney Research) Evgeni Sorkine (ETH Zurich) Olga Sorkine-Hornung (ETH Zurich)
Robust, Error Tolerant Photometric Projector Compensation
September 14, 2015
Transactions on Image Processing 2015
Anselm Grundhöfer (Disney Research) Daisuke Iwai (Osaka University)
Augmenting Physical Avatars Using Projector Based Illumination
November 1, 2013
ACM SIGGRAPH Asia 2013
Amit Bermano (Disney Research/ETH Joint PhD) Phillipp Bruschweiler (Disney Research/ETH Joint M.Sc.) Anselm Grundhöfer (Disney Research) Daisuke Iwai (Osaka University) Bernd Bickel (Disney Research) Markus Gross (Disney Research/ETH Zurich)
Practical Non-linear Photometric Projector Compensation
June 28, 2013
IEEE International Workshop on Computational Cameras and Displays (CCD/PROCAMS) 2013
Anselm Grundhöfer (Disney Research)