Realistic Dynamic Projection Mapping
Using Real-Time Ray Tracing

image

We propose the introduction of modern rendering techniques, such as path tracing, to realistic dynamic projection mapping. Path-tracing rendering requires significant time, but dynamic projection mapping requires high-frame-rate rendering, e.g., 500- 1000 fps. To overcome this gap, our method leverages the concept of persistence of vision. We find that path-traced noisy images can be integrated perceptually, even in dynamic scenes, by being projected them at 947 fps. The reproduced images can be consistent with the physical motion and observer viewpoint at low latency while being highly realistic.


image
Image
Image
Image
Image

References

  • Takashi Nomoto, Ryo Koishihara, and Yoshihiro Watanabe: Realistic Dynamic Projection Mapping Using Real-Time Ray Tracing, SIGGRAPH Emerging Technologies, August 2020. [link]