Patrik Goorts

An End-to-end system for Free Viewpoint Video for Smooth Camera Transitions

details

Authors: Patrik Goorts, Maarten Dumont, Sammy Rogmans and Philippe Bekaert

Language: English

Year: 2012

Journal: Proceedings of the Second International Conference on 3D Imaging (IC3D 2012)

Link: http://patrikgoorts.com/Publications/goorts2012end.pdf

Images and videos

See the projects page.

Bibtex

@inproceedings{goorts2012end,
	title={An End-to-end system for Free Viewpoint Video for Smooth Camera Transitions},
	author={Goorts, P. and Dumont, M. and Rogmans, S. and Bekaert, P.},
	booktitle={Proceedings of the Second International Conference on 3D Imaging (IC3D 2012)},
	year={2012},
	organization={3D Stereo Media}
}

Abstract

In this paper, we present an end-to-end system for free viewpoint video for smooth camera transitions in sport scenes. Our system consists of a network of static computer vision cameras, a storage infrastructure and an interpolation rendering module, connected with a 10 Gigabit Ethernet network. The user of the system requests a viewpath for the virtual camera and the rendering module then generates the images using a depth-aware plane sweep approach. First, the foreground and background are separated and rendered independently. The foreground is rendered using a plane-sweep approach and the obtained depth map is split up in groups of players. Each group is assigned a global depth, which is used in a second plane sweep to restrict the depth. This will reduce artifacts, such as extra limbs and ghost players. The algorithm is demonstrated on actual soccer recordings. The system is fully automatic and can work in near real-time, thus providing virtual images of high quality in a fast manner.