Technical Report MSC-2018-26

Title: Template Matching with Deformable Diversity Similarity
Authors: Itamar Talmi
Supervisors: Lihi Zelnik-Manor
PDFCurrently accessibly only within the Technion network
Abstract: The task of seeking a given template in a given image is called Template Matching. A template matching algorithm gets two inputs. The first input is a small image, representing a pattern or a template. Such a template can be any object, like a face, a logo, or any other item. The second input to the template matching algorithm is a larger image, denoted as the target image. The output should be a box, locating the template inside the target image. Template Matching is a key component in many computer vision applications such as object detection, tracking, surveillance, medical imaging and image stitching.

Our interest is in Template Matching “in the wild”, i.e., when no prior information is available on the target image or the template. Also, the template might undergo severe appearance changes in the target image. Such appearance changes can be out of plane rotation, complex deformations, significant background clutter, and occlusions. All these changes are hard to model. Hence, many existing methods that assume a deformation model or a template prior, fail in these conditions.

We propose a novel measure for template matching ”in the wild” named Deformable Diversity Similarity – based on the diversity of feature matches between a target image window and the template. We rely on both local appearance and geometric information that jointly lead to a powerful approach for matching. Our key contribution is a similarity measure, that is robust to all the challenges stated above. Empirical evaluation on the most up-to-date benchmark shows that our method outperforms the current state-of-the-art in its detection accuracy while improving computational complexity.

CopyrightThe above paper is copyright by the Technion, Author(s), or others. Please contact the author(s) for more information

Remark: Any link to this technical report should be to this page (, rather than to the URL of the PDF files directly. The latter URLs may change without notice.

To the list of the MSC technical reports of 2018
To the main CS technical reports page

Computer science department, Technion