Method, apparatus and computer program product for providing object tracking using template switching and feature adaptation

• US 8,718,324 B2
• Filed: 06/15/2011
• Issued: 05/06/2014
• Est. Priority Date: 06/22/2010
• Status: Active Grant

• Current Assignee: WSOU Investments, LLC (WSOU Holdings, LLC)
• Original Assignee: Nokia Corporation
• Inventors: Fan, Lixin
• Primary Examiner(s): Tabatabai, Abolfazl
• Application Number:
  US13/161,428
• Publication Number:
  US 20110311100A1
• Time in Patent Office: 1,056 Days
• Field of Search: 382/103, 382/107, 382/236, 348/169, 348/170, 348/171, 348/172, 348/208.1, 348/208.2, 348/208.14, 348/94, 348/154, 348/155, 348/352
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/20004 Adaptive image processing
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/248 involving reference images or patches

Abstract

A method, apparatus and computer program product are provided that may enable devices to provide improved object tracking, such as in connection with computer vision, multimedia content analysis and retrieval, augmented reality, human computer interaction and region-based image processing. In this regard, a method includes adjusting parameters of a portion of an input frame having a target object to match a template size and then performing feature-based image registration between the portion of the input frame and an active template and at least one selected inactive template. The method may also enable switching the selected inactive template to be an active template for a subsequent frame based at least on a matching score between the portion of the input frame and the selected inactive template and determine a position of a target object in the input frame based on one of the active template or the selected inactive template.

Claims

1. A method comprising:

adjusting parameters of a portion of an input frame having a target object therein to match a template size;

performing, via a processor, feature-based image registration between the portion of the input frame and an active template and at least one selected inactive template;

enabling switching the selected inactive template to be an active template for a subsequent frame based at least on a matching score between the portion of the input frame and the selected inactive template; and

determining a position of a target object in the input frame based on one of the active template or the selected inactive template,

wherein the selected inactive template comprises a highest ranked inactive template of a plurality of candidate templates scored with respect to a ratio of a number of best-best-match points to a total number of template key points.

2. A method according to claim 1 further comprising adding the portion of the input frame as a candidate template.

3. A method according to claim 1 wherein determining the position of the target object comprises determining the position using one of the active template or the selected inactive template that provides a matching score more indicative of a match with the portion of the input frame.

4. A method according to claim 1 wherein adjusting parameters of the portion of the input frame comprises cropping, rotating and resizing the portion of the input frame.

5. A method according to claim 1 further comprising accumulating the ratio for each candidate template.

6. An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to at least:

adjust parameters of a portion of an input frame having a target object therein to match a template size;

perform feature-based image registration between the portion of the input frame and an active template and at least one selected inactive template;

enable switching the selected inactive template to be an active template for a subsequent frame based at least on a matching score between the portion of the input frame and the selected inactive template; and

determine a position of a target object in the input frame based on one of the active template or the selected inactive template,

wherein the selected inactive template comprises a highest ranked inactive template of a plurality of candidate templates scored with respect to a ratio of a number of best-best-match points to a total number of template key points.

7. An apparatus according to claim 6 wherein the at least one memory and stored computer program code are further configured, with the at least one processor, to cause the apparatus to add the portion of the input frame as a candidate template.

8. An apparatus according to claim 6 wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to determine the position of the target object by determining the position using one of the active template or the selected inactive template that provides a matching score more indicative of a match with the portion of the input frame.

9. An apparatus according to claim 6 wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to adjust parameters of the portion of the input frame by cropping, rotating and resizing the portion of the input frame.

10. An apparatus according to claim 6 wherein the at least one memory and stored computer program code are further configured, with the at least one processor, to cause the apparatus to accumulate the ratio for each candidate template.

11. The apparatus of claim 6 wherein the apparatus comprises or is embodied on a mobile terminal.

12. The apparatus of claim 11 wherein the mobile terminal also comprises a user interface and user interface circuitry configured to control at least some functions of the user interface.

13. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program instructions stored therein, the computer-readable program instructions, when executed by a processor, configured to cause an apparatus to perform:

adjusting parameters of a portion of an input frame having a target object therein to match a template size;

conducting feature-based image registration between the portion of the input frame and an active template and at least one selected inactive template;

enabling switching the selected inactive template to be an active template for a subsequent frame based at least on a matching score between the portion of the input frame and the selected inactive template; and

determining a position of a target object in the input frame based on one of the active template or the selected inactive template,

wherein the selected inactive template comprises a highest ranked inactive template of a plurality of candidate templates scored with respect to a ratio of a number of best-best-match points to a total number of template key points.

14. A computer program product according to claim 13 further comprising program instructions configured to add the portion of the input frame as a candidate template.

15. A computer program product according to claim 13 wherein the program instructions configured to determine the position of the target object comprise program instructions configured to determine the position using one of the active template or the selected inactive template that provides a matching score more indicative of a match with the portion of the input frame.

16. A computer program product according to claim 13 wherein the program instructions configured to adjust parameters of the portion of the input frame comprise program instructions configured to crop, rotate and resize the portion of the input frame.

17. A computer program product according to claim 13 further comprising the program instructions configured to accumulate the ratio for each candidate template.