OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

3D Interest maps from simultaneous video recordings

Carlier, Axel and Calvet, Lilian and Nguyen, Duong-Trung-Dung and Ooi, Wei Tsang and Gurdjos, Pierre and Charvillat, Vincent 3D Interest maps from simultaneous video recordings. (2014) In: MM '14, 3 November 2014 - 7 November 2014 (Orlando, Florida, United States).

(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: http://dx.doi.org/10.1145/2647868.2654947


We consider an emerging situation where multiple cameras are filming the same event simultaneously from a diverse set of angles. The captured videos provide us with the multiple view geometry and an understanding of the 3D structure of the scene. We further extend this understanding by introducing the concept of 3D interest map in this paper. As most users naturally film what they find interesting from their respective viewpoints, the 3D structure can be annotated with the level of interest, naturally crowdsourced from the users. A 3D interest map can be understood as an extension of saliency maps in the 3D space that captures the semantics of the scene. We evaluate the idea of 3D interest maps on two real datasets, taken from the environment or the cameras that are equipped enough to have an estimation of the poses of cameras and a reasonable synchronization between them. We study two aspects of the 3D interest maps in our evaluation. First, by projecting them into 2D, we compare them to state-of-the-art saliency maps. Second, to demonstrate the usefulness of the 3D interest maps, we apply them to a video mashup system that automatically produces an edited video from one of the datasets.

Item Type:Conference or Workshop Item (Paper)
Additional Information:Thanks to ACM editor. The definitive version is available at http://dl.acm.org This papers appears in MM'14 Proceedings of the ACM International Conference on Multimedia ISBN: 978-1-4503-3063-3. The original PDF is available at: http://dl.acm.org/citation.cfm?id=2654947
HAL Id:hal-04080583
Audience (conference):International conference proceedings
Uncontrolled Keywords:
Institution:French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Other partners > National University of Singapore - NUS (REPUBLIC OF SINGAPORE)
Other partners > Simula Research Laboratory - SRL (NORWAY)
Laboratory name:
Deposited On:25 Mar 2015 10:05

Repository Staff Only: item control page