OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

Using Curvilinear Features in Focus for Registering a Single Image to a 3D Object

Rashwan, Hatem A. and Chambon, Sylvie and Gurdjos, Pierre and Morin, Géraldine and Charvillat, Vincent Using Curvilinear Features in Focus for Registering a Single Image to a 3D Object. (2019) IEEE Transactions on Image Processing, 28 (9). 4429- 4443. ISSN 1057-7149

(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


In the context of 2D/3D registration, this paper introduces an approach that allows for matching features detected in two different modalities, photographs, and 3D models, by using a common 2D representation. More precisely, 2D images are matched with a set of depth images representing the 3D model. After introducing the concept of Curvilinear Saliency, which is related to curvature estimation, we propose a new ridge and valley detector for depth images rendered from 3D models. A variant of this detector is adapted to photographs, first by considering multi-scale features and second by integrating the focus curve principle. Finally, a registration algorithm determines the correct view of the 3D model and, thus, the pose of the photograph. This approach relies on the Histogram of Curvilinear Saliency (HCS), an adaptation of the Histogram of Oriented Gradients (HOG) to the proposed features in 2D and 3D. The presented results highlight both the quality of the features detected in terms of repeatability and the interest of the approach for registration and pose estimation.

Item Type:Article
Additional Information:Thanks to IEEE editor. The definitive version is available at http://ieeexplore.ieee.org The original PDF can be found at IEEE Transactions on Image Processing (ISSN 1057-7149) website : https://ieeexplore.ieee.org/document/8694929
HAL Id:hal-02891651
Audience (journal):International peer-reviewed journal
Uncontrolled Keywords:
Institution:Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Laboratory name:
Deposited On:07 Jul 2020 07:17

Repository Staff Only: item control page