Method of describing object region data, apparatus for generating object region data, video processing apparatus and video processing method

• US 7,428,316 B2
• Filed: 05/10/2007
• Issued: 09/23/2008
• Est. Priority Date: 01/28/1999
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Yamamoto, Koji, Kaneko, Toshimitsu, Mita, Takeshi, Hori, Osamu
• Primary Examiner(s): Bella; Matthew C.
• Assistant Examiner(s): TUCKER, WESLEY J
• Application Number:
  US11/747,038
• Publication Number:
  US 20070211945A1
• Time in Patent Office: 502 Days
• Field of Search: 382/100, 382/103, 382/107, 382/241
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06V 10/46 Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features colour feature extraction G06V10/56
• CPC Class Codes: G06V 10/471 using approximation functions
• CPC Class Codes: G06V 10/752 Contour matching
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/54 using feature points or meshes
• CPC Class Codes: H04N 19/543 using regions
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A region data describing method for describing, over a plurality of frames, region data about the region of an arbitrary object in a video, the method specifying the object region in the video with at least either of an approximate figure approximating the region or characteristic points of the region, approximating a trajectory obtained by arranging position data of the representative points or the characteristic point in a direction in which frames proceed with a predetermined function and describing the parameter of the function as region data. Thus, the region of a predetermined object in the video can be described with a small quantity of data. Moreover, creation and handling of data can easily be performed.

Claims

1. A region data describing apparatus for describing information of a moving object region in a video sequence, the apparatus comprising:

a first describing unit configured to describe time data including a start time and a duration time of the object region in the video sequence;

a second describing unit configured to describe type data specifying a type of figure, corresponding to the object region, the type data also specifying a number of vertices of the figure; and

a third describing unit configured to describe figure data specifying a trajectory of at least one of the vertices through at least three successive frames, the figure data including;

time arrangement data including times of points used to determine the trajectory,

key value data representing values of the points used to determine the trajectory, and

function data for indicating the trajectory of at least one of the vertices and therefore also the trajectory of the object region, using information, the information indicating an order of a function used to determine the trajectory or that no function is defined.

2. An apparatus of claim 1, wherein:

the function data is used to indicate the trajectory using a formula;

f(t)=f_a+ν

_a(t−

t_a),

where ν

_a=(f_b−

f_a)/(t_b−

t_a) when the order of the function used to indicate the trajectory is first order, where t_a represents a time of a first point of the points used to determine the trajectory, t_b represents a time of a second point of the points used to determine the trajectory, f_a is a coordinate of the first point, f_b is a coordinate of the second point, and t is a time of a point to be determined.

3. An apparatus of claim 1, wherein the function data further comprises:

parameter data specifying a second order coefficient for the trajectory when an order of a function indicating the trajectory is second order.

4. An apparatus of claim 3, wherein the function data is used to indicate the trajectory using a formula:

f(t)=f_a+ν

_a(t−

t_a)+1/2 a_a(t−

t_a)²,

where ν

_a=(f_b−

f_a)/(t_b−

t_a)−

1/2 a_a(t_b−

t_a) when the order of the function used to indicate the trajectory is second order, where ta represents a time of a first point of the points used to determine the trajectory, t_b represents a time of a second point of the points used to determine the trajectory, f_a is a coordinate of the first point, f_b is a coordinate of the second point, and t is a time of a point to be determined.

5. An apparatus of claim 1, further comprising a fourth describing unit configured to describe hypermedia information.

6. An apparatus of claim 1, wherein:

the vertices of the figure are ordered clockwise.

7. An apparatus of claim 6, wherein:

the vertices of the figure are continuously ordered.

8. An apparatus of claim 7, wherein:

the integer represents all of the vertices of the figure without omitting any vertices.

9. An apparatus of claim 1, wherein:

the time arrangement data are sorted in increasing order.