Method for motion-compensated prediction of moving images and device for performing said method

• US 6,970,507 B1
• Filed: 10/23/2000
• Issued: 11/29/2005
• Est. Priority Date: 10/25/1999
• Status: Expired due to Fees

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Musmann, Hans-Georg, Wedi, Thomas
• Primary Examiner(s): Kelley, Chris
• Assistant Examiner(s): REKSTAD, ERICK J
• Application Number:
  US09/694,211
• Time in Patent Office: 1,863 Days
• Field of Search: 348/390.1, 348/443, 348/458, 348/581, 348/452, 348/448, 375/240.16, 375/240.26, 375/240.12, 375/240.21
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution

Abstract

Past image point information is also considered as well as local neighboring image point information in the interpolation of a predicted picture for motion-compensated prediction of moving pictures with increased resolution. Motion-compensated image point information is used in the interpolation raster between the scanned values of the reference picture (s′(t−1)) for the predicted picture of increased resolution.

Claims

1. A process for motion-compensated prediction of moving images or pictures using an interpolation method considering past image points as well as neighboring image points, said process comprising the steps of:

a) making a motion-compensated picture signal (ŝ

_tri(t−

1)) using past image point information (s_tri(t−

2)), wherein said past image point information is displaced or shifted to obtain said motion-compensated picture signal (ŝ

_tri(t−

1)) according to a product of a scanning rate increase factor (L) and a previously determined motion vector (d(t−

1));

b) producing an intermediate picture (s_e(t−

1)) from a reference picture (s′

(t−

1)) by increasing scanning rate by said scanning rate increase factor (L) and inserting marker values (m) at intervening points between image points of the reference picture (s′

(t−

1)) to form an interpolation raster; and

c) replacing said marker values (m) in said intermediate picture (s_e(t−

1)) at locations in said intermediate picture where image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)) is present with said image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)) and retaining values in said intermediate picture at other locations in said intermediate picture where image point information of said motion-compensated picture signal is not present.

2. The process as defined in claim 1, further comprising replacing said marker values (m) that are not replaced by said image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)) by locally interpolated image data, thus producing a resulting interpolated picture signal (s′

u(t−

1)).

3. A device for motion-compensated prediction of moving images or pictures comprising a time recursive interpolation filter;

wherein said time recursive interpolation filter includes

means (1) for increasing a scanning rate of a reference picture (s′

(t−

1)) by a scanning rate increase factor (L) and for inserting marker values (m) at intervening points between image points of the reference picture (s′

(t−

1)) to form an interpolation raster and an intermediate picture signal (s_e(t−

1));

an image memory (2) for storing past image point information (s_tri(t−

2));

means (4) for making a motion-compensated picture signal (ŝ

_tri(t−

1)) using said past image point information (s_tri(t−

2)) according to a product of said scanning rate increase factor (L) and a previously determined motion vector (d(t−

1)); and

a merging module (3) for replacing said marker values (m) in said intermediate picture (s_e(t−

1)) at locations where image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)) is present with said image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)) and retaining values in said intermediate picture at other locations in said intermediate picture where image point information of said motion-compensated picture signal is not present.

4. The device as defined in claim 3, further comprising an interpolation stage (5) for local interpolation at said marker values (m) that are not replaced by said image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)).

5. The device as defined in claim 3, wherein said means (4) for making a motion-compensated picture signal (ŝ

_tri(t−

1)) has a picture memory (6) and means for preparing a count index for each newly entered one of said image points in said picture memory (6), and, when one of said image points has a value of said count index corresponding to a predetermined dwell time limit, said one of said image points is removed from said picture memory (6).

6. A process for motion-compensated prediction of moving images or pictures using an interpolation method considering past image points as well as neighboring image points, said process comprising the steps of:

a) producing an intermediate picture (s_e(t−

1)) from a reference picture (s′

(t−

1)) by increasing scanning rate by a scanning rate increase factor (L) and inserting marker values (m) at intervening points between image points of the reference picture (s′

(t−

1)) to form an interpolation raster;

b) making a motion-compensated picture signal (ŝ

_tri(t−

1)) using past image point information (s_tri(t−

2)), wherein said past image point information is displaced or shifted to obtain said motion-compensated picture signal (ŝ

_tri(t−

1)) according to a product of said scanning rate increase factor (L) and a previously determined motion vector (d(t−

1)); and

c) replacing said marker values (m) in said intermediate picture (s_e(t−

1)) at locations in said intermediate picture where image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)) is present with said image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)) and retaining values in said intermediate picture at other locations in said intermediate picture where image point information of said motion-compensated picture signal is not present.

7. The process as defined in claim 6, further comprising replacing said marker values (m) that are not replaced by said image point information of said motion-compensated picture signal (ŝ

_tri(t−

1)) by locally interpolated image data, said locally interpolated image data being derived from said image point information of said motion-compensated picture signal and the image points of the reference picture, thus producing a resulting interpolated picture signal ((s′

u (t−

1)).