Image processing apparatus and method for tracking a location of a target subject

• US 8,538,073 B2
• Filed: 11/20/2009
• Issued: 09/17/2013
• Est. Priority Date: 11/21/2008
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jang, Soon-geun, Ahn, Eun-sun
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): ANSARI, TAHMINA N
• Application Number:
  US12/622,620
• Publication Number:
  US 20100128929A1
• Time in Patent Office: 1,397 Days
• Field of Search: 382/103, 382/104, 382/105, 382/106, 382/107, 382/108, 382/232, 382/233, 382/234, 382/235, 382/236, 382/237, 382/238, 382/239, 382/240, 382/241, 382/242, 382/243, 382/244, 382/245, 382/246, 382/247, 382/248, 382/249, 382/250, 382/251, 382/252, 348/14.1, 348/97, 348/143, 348/144, 348/145, 348/146, 348/147, 348/148, 348/149, 348/150, 348/151, 348/52, 348/153, 348/154, 348/208.1, 348/208.2, 348/208.3, 348/208.4, 348/208.14, 348/208.16, 348/220.1, 348/335, 348/336, 348/345, 348/352, 348/402.1, 348/407.1, 348/413.1, 348/416.1, 348/431.1, 348/441, 348/451, 348/452, 348/699, 348/700
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/248 involving reference images or patches

Abstract

A digital image processing apparatus has a tracking function for tracking a location variation of a set tracking area on a plurality of frame images. The digital image processing apparatus includes a similarity calculation unit that calculates a similarity by varying a location of a template on one frame image. The similarity calculation unit calculates a second direction similarity by fixing a first direction location of the template in a first direction on the one frame image and by varying a second direction location of the template in a second direction which is perpendicular to the first direction, and then calculates a first direction similarity by fixing the second direction location of the template at a location where the second direction similarity is the highest and by varying the first direction location of the template in the first direction on the one frame image.

Claims

1. A digital image processing apparatus having a tracking function for tracking a location variation of a set tracking area on a plurality of frame images, the apparatus comprising:

a processor comprising a similarity calculation unit having a frame image input, a template input, and a similarity output, the similarity calculation unit configured to calculate the similarity output by;

(a) varying a location of a template on one frame image, wherein the similarity calculation unit

(i) calculates a second direction similarity by

holding a first direction location of the template constant in a first direction on the one frame image and

varying a second direction location of the template in a second direction on the one frame image, the second direction being perpendicular to the first direction, and

(ii) then calculates a first direction similarity by

holding the second direction location of the template constant at a location where the second direction similarity is the highest and

varying the first direction location of the template in the first direction on the one frame image; and

(b) outputting the first direction similarity and the second direction similarity via the similarity output.

2. The apparatus of claim 1, wherein the template on the one frame image is a tracking area set on a previous frame image.

3. The apparatus of claim 2, wherein, when the second direction similarity is calculated, the similarity calculation unit regards a location or a neighboring location of the tracking area set on the previous frame image, in the first direction, as the first direction location of the template in the first direction.

4. The apparatus of claim 1, further comprising a tracking area determination unit having a similarity input and a tracking area output, the tracking area determination unit configured to determine a portion of the one frame image which is most similar to the template as the tracking area based on a calculation result of the similarity calculation unit received via the similarity input, and output the determined portion as the tracking area.

5. The apparatus of claim 4, wherein the tracking area is the same size as the template.

6. The apparatus of claim 4, wherein the tracking area determination unit determines a location where the first direction similarity is the highest as a location of the tracking area on the one frame image.

7. The apparatus of claim 6, wherein the tracking area is the same size as the template.

8. The apparatus of claim 1, wherein, after the second direction similarity and the first direction similarity are calculated, the similarity calculation unit re-calculates the second direction similarity by holding the first direction location of the template constant at a location where the first direction similarity is the highest and by varying the second direction location of the template in the second direction on the one frame image.

9. The apparatus of claim 8, wherein, after the second direction similarity is re-calculated, the similarity calculation unit re-calculates the first direction similarity by holding the second direction location of the template constant at a location where the re-calculated second direction similarity is the highest and by varying the first direction location of the template in the first direction on the one frame image.

10. The apparatus of claim 1, wherein the similarity calculation unit repeatedly calculates the second direction similarity and the first direction similarity a plurality of times.

11. The apparatus of claim 1, wherein the first direction is one of horizontal and vertical directions and the second direction is the other of the horizontal and vertical directions.

12. A method of controlling a digital image processing apparatus, the method comprising:

(a) calculating a second direction similarity by regarding a tracking area set on a previous frame image as a template on a current frame image, regarding a location or a neighboring location of the tracking area in a first direction on the previous frame image as a first direction location of the template in the first direction, holding the first direction location of the template constant, varying a second direction location of the template in a second direction which is perpendicular to the first direction; and

(b) calculating a first direction similarity by holding the second direction location of the template constant at a location where the second direction similarity is the highest, which is determined in (a), and by varying the first direction location of the template in the first direction on the current frame image.

13. The method of claim 12, further comprising (c) determining a location where the first direction similarity is the highest, which is determined in (b), as a location of the tracking area on the current frame image.

14. The method of claim 13, wherein the tracking area is the same size as the template.

15. The method of claim 12, further comprising (c) re-calculating the second direction similarity by holding the first direction location of the template constant at a location where the first direction similarity is the highest, which is determined in (b), and by varying the second direction location of the template in the second direction on the current frame image.

16. The method of claim 15, further comprising (d) determining a location where the second direction similarity is the highest, which is determined in (c), as a location of the tracking area on the current frame image.

17. The method of claim 16, wherein the tracking area is the same size as the template.

18. The method of claim 15, further comprising (d) re-calculating the first direction similarity by holding the second direction location of the template constant at a location where the second direction similarity is the highest, which is determined in (c), and by varying the first direction location of the template in the first direction on the current frame image.

19. The method of claim 18, further comprising (e) determining a location where the first direction similarity is the highest, which is determined in (d), as a location of the tracking area on the current frame image.

20. The method of claim 19, wherein the tracking area is the same size as the template.

21. The method of claim 12, wherein the first direction is one of horizontal and vertical directions and the second direction is the other of the horizontal and vertical directions.

22. A non-transitory computer readable storage medium having stored thereon a program executable by a processor for performing a method, the method comprising:

(a) calculating a second direction similarity by regarding a tracking area set on a previous frame image as a template on a current frame image, regarding a location or a neighboring location of the tracking area in a first direction on the previous frame image as a first direction location of the template in the first direction, holding the first direction location of the template constant, varying a second direction location of the template in a second direction which is perpendicular to the first direction; and

(b) calculating a first direction similarity by holding the second direction location of the template constant at a location where the second direction similarity is the highest, which is determined in (a), and by varying the first direction location of the template in the first direction on the current frame image.