OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

Audiovisual annotation procedure for multi-view field recordings

Guyot, Patrice and Malon, Thierry and Roman Jimenez, Geoffrey and Chambon, Sylvie and Charvillat, Vincent and Crouzil, Alain and Péninou, André and Pinquier, Julien and Sèdes, Florence and Sènac, Christine Audiovisual annotation procedure for multi-view field recordings. (2018) In: 25th International Conference on Multimedia Modeling (MMM 2019), 8 January 2019 - 11 January 2019 (Thessaloniki, Greece).

(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: https://doi.org/10.1007/978-3-030-05710-7_33


Audio and video parts of an audiovisual document interact to produce an audiovisual, or multi-modal, perception. Yet, automatic analysis on these documents are usually based on separate audio and video annotations. Regarding the audiovisual content, these annotations could be incomplete, or not relevant. Besides, the expanding possibilities of creating audiovisual documents lead to consider different kinds of contents, including videos filmed in uncontrolled conditions (i.e. fields recordings), or scenes filmed from different points of view (multi-view). In this paper we propose an original procedure to produce manual annotations in different contexts, including multi-modal and multi-view documents. This procedure, based on using both audio and video annotations, ensures consistency considering audio or video only, and provides additionally audiovisual information at a richer level. Finally, different applications are made possible when considering such annotated data. In particular, we present an example application in a network of recordings in which our annotations allow multi-source retrieval using mono or multi-modal queries.

Item Type:Conference or Workshop Item (Paper)
Additional Information:Thanks to Springer editor. This paper appears in volume 11295 of Lecture Notes in Computer Science ISSN : 0302-9743 ISBN 978-3-030-05709-1 The original PDF is available at: https://link.springer.com/chapter/10.1007%2F978-3-030-05710-7_33
Audience (conference):International conference proceedings
Uncontrolled Keywords:
Institution:Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Laboratory name:
Deposited On:02 Mar 2020 15:28

Repository Staff Only: item control page