METHOD AND APPRATUS FOR TRACKING OBJECTS

• US 20140348380A1
• Filed: 01/24/2014
• Published: 11/27/2014
• Est. Priority Date: 05/24/2013
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: YOON, Youngwoo, YUN, Woo han, YOON, Ho sub, LEE, Jae Yeon, KIM, Do-Hyung, KIM, Jae Hong, PARK, Jong-Hyun
• Application Number:
  US14/163,265
• Publication Number:
  US 20140348380A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 10/62 relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking

Abstract

A method for tracking an object in an object tracking apparatus includes receiving an image frame of an image; and detecting a target, a depth analogous obstacle and an appearance analogous obstacle; tracking the target, the depth analogous obstacle and the appearance analogous obstacle; when the detected target overlaps the depth analogous obstacle, comparing the variation of tracking score of the target with that of the depth analogous obstacle. Further, the method includes continuously tracking the target when the variation of tracking score of the target is below that of the depth analogous obstacle and processing a next frame when the variation of tracking score of the target is above that of the depth analogous obstacle; and re-detecting the target.

Claims

1. A method for tracking an object in an object tracking apparatus, the method comprising:

receiving an image frame of an image captured by the image acquisition apparatus;

detecting a target, a depth analogous obstacle with a similar depth to the target and an appearance analogous obstacle with a similar appearance to the target from the image frame;

tracking the target, the depth analogous obstacle and the appearance analogous obstacle that are detected;

when the detected target overlaps the depth analogous obstacle, comparing the variation of tracking score of the target with that of the depth analogous obstacle;

continuously tracking the target when the variation of tracking score of the target is below that of the depth analogous obstacle and processing a next frame when the variation of tracking score of the target is above that of the depth analogous obstacle; and

re-detecting the target.

2. The method of claim 1, wherein said re-detecting the target comprises:

checking whether the re-detected target is the appearance analogous obstacle; and

tracking the re-detected target when the re-detected target is not the appearance analogous obstacle and tracking the appearance analogous obstacle when the re-detected target is the appearance analogous obstacle.

3. The method of claim 2, further comprising:

when the target is not re-detected, tracking both of the depth analogous obstacle and the appearance analogous obstacle.

4. The method of claim 1, wherein the depth analogous obstacle is set by performing:

projecting the image frame onto an X-Z plane;

producing a top-view image based on a predetermined range of pixels with reference to the depth of the target; and

performing an binarization on the produced top-view image and removing blobs from the binarized image.

5. The method of claim 4, wherein an X-axis represents a horizontal axis of the image frame, a Y-axis represents a vertical axis of the image frame and Z-axis represents the depth of the target.

6. The method of claim 1, wherein the appearance analogous obstacle is set by designating remaining objects with the exception of the target from the tracking result obtained by running an object tracker as the appearance analogous obstacle.

7. The method of claim 1, wherein the depth analogous obstacle is used to modify a color model of an object tracker in order to increase the color distinction ability between the target and the depth analogous obstacle by performing the histogram normalization process such as the following Equation when modeling the color of the target.

q=q/q₀

where q and q₀ at a right term denote a color histogram of the target and a color histogram of the depth analogous obstacle, respectively, and q at a left term denotes a updated color histogram.

8. The method of claim 1, wherein said comparing the variation of tracking score of the target comprises, when the detected target overlaps the appearance analogous obstacle, determining which one of the target and the depth analogous obstacle is in front of another using the following Equation,

stdev({P₁ⁱ}_{i=t-k, . . . ,t})area(Obj₁)<

stdev({P₂ⁱ}_{i=t-k, . . . ,t})area(Obj₂)

where stdev means a standard deviation, Obj₁ means a first target, area(Obj₁) means an area size of a first target, P₁ⁱ means a tracking score of the first object acquired by the object tracker in an i-th image frame, Obj₂ means a second target, area(Obj₂) means an area size of the second target, P₂ⁱ means a tracking score of the second object acquired by the object tracker in the i-th image frame, t represents an index of a current image frame, and k is a setting of the user.

9. The method of claim 1, wherein the image acquisition apparatus comprises a RGB camera and the RGB camera produces a RGB image and a depth image.

10. An apparatus for tracking an object, the apparatus comprising:

an input unit configured to receive an image frame of an image captured by an image acquisition apparatus;

a detection unit configured to detect a target, a depth analogous obstacle with a similar depth to the target, and an appearance analogous obstacle with a similar appearance to the target from the image frame;

a tracking unit configured to track the target, the depth analogous obstacle and the appearance analogous obstacle that are detected;

a comparison unit configured to compare the variation of tracking score of the target with that of the depth analogous obstacle when the detected target overlaps the depth analogous obstacle; and

an overlap analysis unit configured to continuously track the target when the variation of tracking score of the target is below that of the depth analogous obstacle and progressing to a next frame when the variation of tracking score of the target is above that of the depth analogous obstacle.

11. The apparatus of claim 10, wherein the overlap analysis unit is further configured to:

re-detect the target;

check whether the re-detected target is the appearance analogous obstacle; and

track the re-detected target when the re-detected target is not the appearance analogous obstacle and track the appearance analogous obstacle when the re-detected target is the appearance analogous obstacle.

12. The apparatus of claim 10, wherein the overlap analysis unit is further configured to track both of the depth analogous obstacle and the appearance analogous obstacle when the target is not re-detected.

13. The apparatus of claim 10, wherein the image acquisition apparatus comprises a RGB camera and the RGB camera includes a RGB sensor and a depth sensor.