Method for encoding a plurality of video signals into a single video signal

• US 8,175,398 B2
• Filed: 11/10/2008
• Issued: 05/08/2012
• Est. Priority Date: 11/10/2008
• Status: Active Grant

• Current Assignee: City University of Hong Kong
• Original Assignee: City University of Hong Kong
• Inventors: Tsang, Peter Wai Ming
• Primary Examiner(s): Do, Anh Hong
• Application Number:
  US12/267,719
• Publication Number:
  US 20100119175A1
• Time in Patent Office: 1,275 Days
• Field of Search: 382/232, 382/235, 382/100, 382/294, 382/276, 348/E5.006, 348/E5.002, 345/473, 709/249, 370/397, 380/252, 375/E7.086
• US Class Current: 382/232
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding

Abstract

A method of encoding video signals into a single video signal includes extracting background images from corresponding video signals, encoding the video signals into a single video signal, the single video signal containing information for reconstructing the video signals, and replacing frames of the single video signal with the background images.

Claims

1. A method for encoding a plurality of video signals into a single video signal comprising:

using a filter for extracting a plurality of background images from a corresponding plurality of video signals,

encoding the plurality of video signals into a single video signal, the single video signal containing information for reconstructing the plurality of video signals, and

replacing frames of the single video signal with the background images.

2. The method of claim 1 wherein the plurality of video signals represent different views or parts of a single scene.

3. The method of claim 1 wherein the extracting a plurality of background images from a corresponding plurality of video signals comprises separating the plurality of video signals into the plurality of background images and a corresponding plurality of foreground image sequences.

4. The method of claim 3 wherein the plurality of video signals comprises N video signals and including extracting N background images, one background image from each of the N video signals.

5. The method of claim 3 wherein the background images comprise low frequency components of the video signals.

6. The method of claim 3 wherein the foreground images comprise high frequency components of the video signals.

7. The method of claim 3 wherein encoding the plurality of video signals into a single video signal comprises, for each corresponding frame of the plurality of video signals, compressing corresponding foreground images of the plurality of video signals and tiling the foreground images compressed into a single frame image.

8. The method of claim 1 wherein encoding the plurality of video signals into a single video signal comprises, for each corresponding frame of the plurality of video signals, compressing corresponding frame images of the plurality of video signals and tiling the frame images compressed into a single frame image.

9. The method of claim 1 wherein replacing frames of the single video signal with the background images comprises interlacing the background images with the video signals encoded.

10. The method of claim 1 wherein the background images are uncompressed.

11. The method of claim 1 further comprising, prior to extracting the background images, splitting each of the plurality of video signals into a series of shorter non-overlapping video subsequences, and, second, performing the steps claim 1 on a group of corresponding ones of the shorter non-overlapping video subsequences.

12. The method claim 11 further comprising, after the splitting but prior to the extracting, determining whether the group of corresponding ones of the shorter non-overlapping video subsequences contain a background image, and, if the video subsequences contain a background image, performing the steps of claim 1 on a group of corresponding ones of the shorter non-overlapping video subsequences.

13. The method of claim 12 wherein, if the video subsequences do not contain a background image, skipping the extracting and replacing and only encodings the group of corresponding ones of the shorter non-overlapping video subsequences.

14. The method of claim 11 comprising separately performing the steps of claim 1 on each group of corresponding ones of the shorter non-overlapping video subsequences in the series to obtain a single series of shorter non-overlapping video subsequences.

15. The method of claim 14 further comprising joining the single series of shorter non-overlapping video subsequences to obtain a single video signal.

16. The method of claim 15 further comprising, prior to joining, inserting a flag at beginning and end of each one of the video subsequences in the single series of shorter non-overlapping video subsequences.