Dynamic projection mapping plays an important role in expanding the availability of augmented reality. However, with only one projector, the projection area is limited, and the shadows are caused by occlusions between objects and projectors. The effective solution to these issues is to arrange multiple projectors around a scene and control them simultaneously. However, in conventional research, since the amount of calculation is large, the projection target is limited to the stationary or quasi-stable state, and it is difficult to increase the number of projectors.
In this paper, we present a new method of mapping projections onto dynamic scenes by using multiple high-speed projectors. Our proposed method controls the intensity in a pixel-parallel manner for each projector, so that each projected image is updated at high speed with low latency. Adaptive shadow removal can be achieved for a projected image even in a complicated dynamic scene. Additionally, our pixel-parallel calculation method allows a distributed system configuration so that the number of projectors can be increased by networked connections for high scalability. We demonstrated seamless mapping onto dynamic scenes at 360 fps by using ten cameras and four projectors. The latency from the motion to the projection completion was about 10 ms.
- Takashi Nomoto, Wanlong Li, Hao-Lun Peng, and Yoshihiro Watanabe: Dynamic Projection Mapping with Networked Multi-projectors Based on Pixel-parallel Intensity Control, SIGGRAPH ASIA Emerging Technologies, December 2020. [link]