In-camera VFX implementation study using short-throw projector (focused on low-cost solution)

As an important part of virtual production, In-camera VFX is the process of shooting actual objects and virtual three-dimensional backgrounds in real-time through computer graphics technology and display technology, and obtaining the final film. In the In-camera VFX process, there are currently only two types of medium used to undertake background imaging, LED wall and chroma key screen. Among them, the In-camera VFX based on LED wall realizes background imaging through LED display technology. Although the imaging quality is guaranteed, the high cost of LED wall increases the cost of virtual production. The In-camera VFX based on chroma key screen, the background imaging is realized by real-time keying technology. Although the price is low, due to the limitation of real-time keying technology and lighting conditions, the usability of the final picture is not high. The short-throw projection technology can compress the projection distance to within 1 meter and get a relatively large picture, which solves the problem of traditional projection technology that must leaving a certain space between screen and the projector, and its price is relatively cheap compared to the LED wall. Therefore, in the In-camera VFX process, short-throw projection technology can be tried to project backgrounds. This paper will analyze the principle of short-throw projection technology and the existing In-camera VFX solutions, and through the comparison experiments, propose a low-cost solution that uses short-throw projectors to project virtual backgrounds and realize the In-camera VFX process.