INTERPOLATION FRAME GENERATING APPARATUS AND METHOD

• US 20110211111A1
• Filed: 09/17/2010
• Published: 09/01/2011
• Est. Priority Date: 03/01/2010
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Yamamoto, Takuma, Mishima, Nao
• Granted Patent: US 8,433,156 B2
• Time in Patent Office: Days
• US Class Current: 348/441
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04N 7/014 involving the use of motion vectors motion estimation and compensation in video coding H04N19/51

Abstract

According to one embodiment, an apparatus includes a motion estimation unit, a generating unit, a detection unit, and a filtering unit. The motion estimation unit is configured to estimate a first motion vector from a first reference frame to a second reference frame. The generating unit is configured to assign a first pixel value and a second motion vector to an interpolation frame. The detection unit is configured to detect an occlusion region in the interpolation frame. The filtering unit is configured to assign the second motion vector to the occlusion region as a third motion vector, calculate degrees of difference between second pixel values derived from the second motion vectors and third pixel values derived from the third motion vectors, and assign a fourth pixel value derived from a fourth motion vector to the occlusion region, wherein the fourth motion vector is calculated based on the degrees of difference.

Claims

1. An apparatus for generating an interpolation frame to be interpolated between first and second reference frames, comprising:

a motion estimation unit configured to estimate a first motion vector joining a first block in the first reference frame to a second block in the second reference frame;

a generating unit configured to assign a first pixel value and a second motion vector to a first position in the interpolation frame, wherein the first pixel value is calculated based on at least one of the first or second reference frames, and the first position is indicated by the first motion vector;

a detection unit configured to detect an occlusion region or a non-occlusion region in the interpolation frame; and

a filtering unit configured to assign the second motion vector which is assigned to a neighboring pixel to the occlusion region as a third motion vector, calculate degrees of difference between second pixel values derived from the second motion vectors and third pixel values derived from the third motion vectors, and assign a fourth pixel value derived from a fourth motion vector to the occlusion region, wherein the fourth motion vector is calculated by weighted mean of the second motion vectors based on the degrees of difference.

2. The apparatus according to claim 1, wherein the filtering unit is configured to assign a third motion vector having the smallest degree of difference to the occlusion region as the fourth motion vector.

3. The apparatus according to claim 1, wherein the filtering unit is configured to perform the weighted mean by using weight that becomes smaller as the degree of difference becomes larger.

4. The apparatus according to claim 1, wherein the detection unit is configured to detect a region to which pixel values is not assigned as the occlusion region.

5. The apparatus according to claim 4, wherein the detection unit is configured to derive first and second pixel difference values, which indicate a difference value between a pixel value assigned to a second pixel position included in the interpolation frame and a pixel value specified by second motion vector assigned to the second pixel position and a difference value between a pixel value assigned to a third pixel position included in the interpolation frame and a pixel value specified by second motion vector assigned to the third pixel position, respectively, and detect one of the second and third pixel positions which has a larger one of the first and second pixel difference values as the occlusion region, when second motion vectors assigned to the second and third pixel positions specify the same pixel in the second reference frame.

6. A method for generating an interpolation frame to be interpolated between first and second reference frames, comprising:

estimating a first motion vector joining a first block in the first reference frame to a second block in the second reference frame;

assigning a first pixel value and a second motion vector to a first position in the interpolation frame, wherein the first pixel value is calculated based on at least one of the first and second reference frames, and the first position is indicated by the first motion vector;

detecting an occlusion region or a non-occlusion region in the interpolation frame;

assigning the second motion vector which is assigned to a neighboring pixel to the occlusion region as a third motion vector;

calculating degrees of difference between second pixel values derived from the second motion vectors and third pixel values derived from the third motion vectors; and

assigning a fourth pixel value derived from a fourth motion vector to the occlusion region, wherein the fourth motion vector is calculated by weighted mean of the second motion vectors based on the degrees of difference.