Method and apparatus for color-based object tracking in video sequences
First Claim
1. A method for tracking a color-based object in video sequences formed with frames, the method comprising:
- (a) assigning an initial object area in one frame of the video sequences desired to be tracked, assigning an initial object effective window containing the initial object area, and calculating a model color histogram of the initial object area using a predetermined bin resolution;
(b) receiving a frame following the frame containing the initial object area assigned in step (a) as a newly input image, and assigning an object search window containing an object area in the newly input image to which the initial object area for tracking were transformed and moved, and the initial object effective window assigned in step (a);
(c) calculating an input color histogram which is a color histogram of the image in the object search window, using the predetermined bin resolution used in step (a);
(d) calculating an object probability image in the object search window, by using the model color histogram of the initial object area and the input color histogram of the image in the object search window;
(e) updating the object effective window of the object area to which the initial object area were transformed and moved, using the object probability image and the initial object effective window so that the area of the object which is the target of tracking is included in the updated new object effective window; and
(f) detecting a new object area in a newly input image, using a predetermined method, from the object probability image obtained in step (d) in the new object effective window finally updated in step (e).
1 Assignment
0 Petitions
Accused Products
Abstract
A method and apparatus for tracking a color-based object in video sequences are provided. According to the method, an initial object area in one frame of video sequences desired to be tracked is assigned, and an initial object effective window containing the initial object area is assigned. A frame following the frame containing the assigned initial object area is received as a newly input image, and an object search window containing the initial object area for tracking and the initial object effective window in the newly input image is assigned. Then, the model histogram of the initial object area corresponding to a predetermined bin resolution value and the input histogram of the image in the object search window are calculated. From the calculated object probability image, using a predetermined method, a new object area to which the initial object area moved is obtained in the next frame in which the initial object area of the frame desired to be tracked is given as a previous (tracked) object area. By doing so, the object in video sequences is tracked. Accordingly, using the continuously extracted video object region information, an object-based interactive-type additional information service function in movies, TV programs, and CFs can be implemented effectively.
40 Citations
17 Claims
-
1. A method for tracking a color-based object in video sequences formed with frames, the method comprising:
-
(a) assigning an initial object area in one frame of the video sequences desired to be tracked, assigning an initial object effective window containing the initial object area, and calculating a model color histogram of the initial object area using a predetermined bin resolution; (b) receiving a frame following the frame containing the initial object area assigned in step (a) as a newly input image, and assigning an object search window containing an object area in the newly input image to which the initial object area for tracking were transformed and moved, and the initial object effective window assigned in step (a); (c) calculating an input color histogram which is a color histogram of the image in the object search window, using the predetermined bin resolution used in step (a); (d) calculating an object probability image in the object search window, by using the model color histogram of the initial object area and the input color histogram of the image in the object search window; (e) updating the object effective window of the object area to which the initial object area were transformed and moved, using the object probability image and the initial object effective window so that the area of the object which is the target of tracking is included in the updated new object effective window; and (f) detecting a new object area in a newly input image, using a predetermined method, from the object probability image obtained in step (d) in the new object effective window finally updated in step (e). - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. An apparatus for tracking a color-based object in video sequences formed with frames comprising:
-
an image input means through which the video sequences are input; a histogram calculating means which calculates a histogram of an image in an area assigned in the video sequence frame, by using a predetermined bin resolution; a means which assigns an initial object area desired to be tracked, in one frame of the video sequences input through the image input means, and sets an initial object effective window containing the initial object area; an object search window assigning means which receives a frame following the frame containing the initial object area, through the image input means, as a new input image, and assigns an object search window containing an object area appearing in the new input image to which the initial object area for tracking were transformed and moved, and the set initial object effective window; an object probability image calculating means which calculates an object probability image within the object search window, by using a model histogram which is a histogram of the initial object area calculated with the histogram calculating means, and an input histogram which is a histogram of an image in the object search window; an object effective window updating means which updates an object effective window of an object area to which the initial object area were transformed and moved, from the object probability image and the initial object effective window so that the object being tracked is included in the newly updated object effective window; and a means which detects a new object area in a new input image frame, by using a predetermined method, from the object probability image in the object effective window which is finally updated in the object effective window updating means. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A computer readable medium having embodied thereon a computer program for tracking a color-based object in video sequences formed with frames,
wherein the tracking of a color-based object comprises: -
(a) assigning an initial object area in one frame of the video sequences desired to be tracked, assigning an initial object effective window containing the initial object area, and calculating a model color histogram of the object area using a predetermined bin resolution; (b) receiving a frame following the frame containing the initial object area assigned in the step (a) as a newly input image, and assigning an object search window containing an object area in the newly input image to which the initial object area for tracking were transformed and moved, and the initial object effective window assigned in the step (a); (c) calculating an input color histogram which is a color histogram of the image in the object search window, using the predetermined bin resolution used in the step (a); (d) calculating an object probability image in the object search window, by using the model color histogram of the initial object area and the input color histogram of the image in the object search window; (e) updating the object effective window of the object area to which the initial object area were transformed and moved, using the object probability image and the initial object effective window so that the area of the object which is the target of tracking is included in the updated new object effective window; and (f) detecting a new object area in a newly input image, using a predetermined method, from the object probability image obtained in the step (d) in the new object effective window finally updated in the step (e). - View Dependent Claims (17)
-
Specification