Encoding a video signal

• US 6,633,676 B1
• Filed: 05/17/2000
• Issued: 10/14/2003
• Est. Priority Date: 05/27/1999
• Status: Expired due to Fees

• Current Assignee: Pendragon Wireless LLC (Pendrell Corporation)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Kleihorst, Richard Petrus, Op De Beeck, Marc Joseph Rita, Van Der Werf, Albert, Van Der Avoird, Andre
• Primary Examiner(s): Couso, Jose L.
• Application Number:
  US09/572,993
• Time in Patent Office: 1,245 Days
• Field of Search: 382/232, 382/236, 382/238, 382/251, 382/254, 382/298, 382/299, 382/300, 382/308, 348/394.1, 348/397.1, 348/399.1, 348/400.1, 348/401.1, 348/404.1, 348/408.1, 348/409.1, 348/411.1, 348/415.1, 348/421.1, 348/422.1, 348/425.1, 348/427.1, 375/240.03, 375/240.04, 375/240.05, 375/240.12, 375/240.13, 375/240.15, 375/240.16, 375/240.17, 375/240.21, 375/240.25, 375/240.27, 375/240.29, 375/240.19
• US Class Current: 382/236
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 7/014 involving the use of motion vectors motion estimation and compensation in video coding H04N19/51

Abstract

Method and arrangement for encoding a video signal, wherein a selection (39) is made between the generation of a motion-compensated encoded video signal (I, B, P) and the generation of a higher-resolution picture (I_H). The creation of the higher-resolution picture (I_H) relies on estimating motion in a series of subsequent pictures (f_1,2,3, . . . ) of lower resolution. The higher-resolution picture (I_H) is interpolated (38) from these pictures (f_1,2,3, . . . ). In a preferred embodiment of the invention, previously determined regions of interest (S(ROI)) are selected (36) from the video signal. The pictures relating to these regions of interest (f_1,2,3, . . . ) occupy less memory (33) than entire pictures as picked up by an image sensor (2). A conventional picture memory (33) is sufficient to store the series of pictures (f_1,2,3, . . . ) that relates to a certain region of interest. Motion estimation (31) is performed on these pictures and their motion vectors (m) are stored in a vector memory (37). The higher-resolution pictures (I_H) are interpolated (38) from the stored pictures (f_1,2,3, . . . ) and their motion vectors (m). The invention is applicable for sensor (2)-encoder (3) integration, for example in a camera system (1).

Claims

1. A method of encoding a video signal comprising a series of pictures (f_1,2,3, . . . ) in a motion-compensated encoder (3), said method comprising the steps of:

receiving (30) the series of pictures (f_1,2,3, . . . ); and

estimating (31) motion vectors (m) in the series of pictures (f_1,2,3, . . . ) with sub-resolution accuracy,

making a choice (39) between generating and supplying a motion-compensated encoded video signal (I, B, P) and generating and supplying a higher-resolution picture (I_H) having a higher resolution than the pictures (f_1,2,3, . . . ) of the series,

if the motion-compensated encoded video signal is generated, forming (38) the motion-compensated encoded video signal (I, B, P) by means of a picture memory (33), and

if the higher-resolution picture (I_H) is generated, forming (38) the higher-resolution picture (I_H) from the series of pictures (f_1,2,3, . . . ) and the motion vectors (m) by means of the picture memory (33).

2. A method of encoding a video signal for obtaining a series of higher-resolution pictures (I_H), comprising the repeated generation and supply of a higher-resolution picture (I_H) as claimed in claim 1, wherein the series of higher-resolution pictures (I_H) is adapted to a predetermined standard output signal.

3. A method as claimed in claim 2, wherein two higher-resolution pictures (I_H) are combined to one interlaced picture.

4. A method as claimed in claim 1, further comprising the steps of:

selecting (36) a predetermined region of interest (S(ROI)) from the video signal, and

storing the series of pictures (f_1,2,3, . . . ) in the picture memory (33), said pictures (f_1,2,3, . . . ) relating to the region of interest (S(ROI)).

5. A motion-compensated encoder (3) for encoding a video signal comprising a series of pictures (f_1,2,3, . . . ), said encoder (3) comprising:

receiving means (30) for receiving the series of pictures (f_1,2,3, . . .),

estimation means (31) for estimating motion vectors (m) in the series of pictures (f_1,2,3, . . . ) with sub-resolution accuracy;

a picture memory (33) for storing the pictures (f_1,2,3, . . . ), and

means for forming and supplying a motion-compensated encoded video signal (I, B, P) by means of the picture memory (33),

combination means (38) for forming and supplying a higher-resolution picture (I_H) from the series of pictures (f_1,2,3, . . . ) and the motion vectors (m) by means of the picture memory (33), said higher-resolution picture (I_H) having a higher resolution than the pictures (f_1,2,3, . . . ) of the series.

6. A motion-compensated encoder as claimed in claim 5, further comprising:

selection means (36) for selecting a predetermined region of interest (S(ROI)) from the video signal,

the picture memory (33) being suitable for storing the series of pictures (f_1,2,3, . . . ), said pictures (f_1,2,3, . . . ) relating to the region of interest (S(ROI)).

7. A camera system (1) comprising:

an image sensor (2) for picking up a video signal which comprises a series of pictures (f_1,2,3, . . . ), and

a motion-compensated encoder (3) for encoding the video signal as claimed in claim 5.