METHOD AND APPARATUS FOR TRACKING OBJECT, AND METHOD AND APPARATUS FOR CALCULATING OBJECT POSE INFORMATION
0 Assignments
0 Petitions
Accused Products
Abstract
A method and apparatus for tracking an object, and a method and apparatus for calculating object pose information are provided. The method of tracking the object obtains object feature point candidates by using a difference between pixel values of neighboring frames. A template matching process is performed in a predetermined region having the object feature point candidates as the center. Accordingly, it is possible to reduce a processing time needed for the template matching process. The method of tracking the object is robust in terms of sudden changes in lighting and partial occlusion. In addition, it is possible to track the object in real time. In addition, since the pose of the object, the pattern of the object, and the occlusion of the object are determined, detailed information on action patterns of the object can be obtained in real time.
-
Citations
33 Claims
-
1-18. -18. (canceled)
-
19. A method of tracking an object comprising:
-
detecting predetermined object feature points in a previous frame; estimating object feature points of a present frame by using a difference between a pixel value of the previous frame and a pixel value of the present frame; estimating whether the estimated object feature points of the present frame are occluded on the basis of a similarity between the estimated object feature points of the present frame and the detected object feature points of the previous frame; and tracking the object based on the detected object feature points of the previous frame corresponding to the occluded object feature points of the present frame when the estimated object feature points of the present frame are occluded. - View Dependent Claims (20, 21, 22, 23)
-
-
24. A method of calculating object pose information comprising:
-
detecting predetermined object feature points in a previous frame; estimating object feature point of a present frame by using a difference between a pixel value of the previous frame and a pixel value of the present frame; calculating object pose information by using coordinate values detected in the previous frame and coordinate values of the object feature points estimated in the present frame; calculating an affine transformation between coordinate values of object feature points detected in the previous frame and coordinate values of object feature points detected in the present frame; calculating the object feature points of the present frame by using the coordinate values of the feature points of the object detected in the previous frame and the calculated affine transformation; and calculating a similarity between the estimated object feature points of the present frame and the calculated object feature points and estimating whether the object feature points are occluded on the basis of the calculated similarity, wherein the object pose information further includes the occlusion information on whether the object feature points in the present frame are occluded. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31)
-
-
32. An apparatus for tracking a video image object, including at least one processing device, the apparatus comprising:
-
an initialization unit which initializes, using the at least one processing device, a tracking process by detecting object feature points from a video image; a first tracking unit which estimates object feature points of a present frame by using a difference between a pixel value of a previous frame and a pixel value of the present frame; and a second tracking unit which estimates whether the estimated object feature points of the present frame are occluded on the basis of a similarity between the estimated object feature points of the present frame and the detected object feature points of the previous frame; and
tracks the object based on the detected object feature points of the previous frame corresponding to the occluded object feature points of the N˜
th frame when the estimated object feature points of the present frame are occluded.
-
-
33. An apparatus for calculating object pose information, including at least one processing device, the apparatus comprising:
-
an initialization unit which initializes, using the at least one processing device, a tracking process by detecting object feature points from a video image; a first tracking unit which estimates object feature points of a present frame by using a difference between a pixel value of a previous frame and a pixel value of the present frame; an object pose information calculation unit which calculates object pose information by using coordinate values of the object feature points estimated by initializing the tracking process and coordinate values of the object feature points of the present frame, wherein the object pose calculation unit includes a pose estimation unit generating rotation matrix information on directions of the object, an occlusion estimation unit generating occlusion information on whether the object feature points are occluded, and a pattern estimation unit generating pattern information on blinking of eyes and a shape of a mouth.
-
Specification