METHOD AND SYSTEM FOR PROVIDING SINGLE VIEW VIDEO SIGNAL BASED ON A MULTIVIEW VIDEO CODING (MVC) SIGNAL STREAM

• US 20120224642A1
• Filed: 03/04/2011
• Published: 09/06/2012
• Est. Priority Date: 03/04/2011
• Status: Active Grant

• Current Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Original Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Inventors: Sines, Gabor, Siniavine, Pavel, Arora, Jitesh, Zorin, Alexander, Cao, Xingping, Callway, Edward, Cherif, Mohamed
• Granted Patent: US 9,118,928 B2
• Time in Patent Office: Days
• US Class Current: 375/240.25
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/00 Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof

Abstract

A method and system for producing a single view video signal based on a multiview video coding (MVC) signal stream. A MVC signal stream representing multiple spatially related views of a scene, including a base view and at least one dependent view, is decoded to provide multiple decoded video signals representing the spatially related views, with respective portions of the MVC signal stream representing one of multiple temporally adjacent video frames, and the MVC signal stream representing multiple sequences of spatially adjacent video frames. The decoded video signals are processed to provide a processed video signal representing one of the spatially related views using image information from more than one of the decoded video signals. As a result, more image data is used during processing, thereby improving the spatial and temporal image quality.

Claims

1. A method of providing a single view video signal based on a multiview video coding (MVC) signal stream, comprising:

processing a MVC signal stream using image information from more than one of said plurality of decoded video signals to provide a processed video signal representing one of said plurality of spatially related views.

2. The method of claim 1, wherein:

said MVC signal stream includes a bitstream corresponding to said base view and at least another bitstream corresponding to said at least one dependent view; and

said decoding a MVC signal stream comprises

decoding said bitstream corresponding to said base view to provide one of said plurality of decoded video signals, and

decoding said bitstream corresponding to said at least one dependent view to provide at least another one of said plurality of decoded video signals.

3. The method of claim 1, wherein:

said MVC signal stream includes a bitstream of which a first portion corresponds to said base view and of which at least a second portion corresponds to said at least one dependent view; and

said decoding a MVC signal stream comprises

decoding said first portion of said bitstream to provide one of said plurality of decoded video signals, and

decoding said at least a second portion of said bitstream to provide at least another one of said plurality of decoded video signals.

4. The method of claim 1, wherein:

respective portions of said MVC signal stream include respective temporal image information corresponding to one of a plurality of temporally adjacent video frames;

respective portions of said MVC signal stream include respective spatial image information corresponding to one of a plurality of sequences of spatially adjacent video frames; and

said processing said plurality of decoded video signals comprises processing said plurality of decoded video signals using at least one of said temporal and spatial image information.

5. The method of claim 4, wherein said processing said plurality of decoded video signals comprises:

processing at least one of said plurality of decoded video signals representing said at least one dependent view to provide said at least one of said temporal and spatial image information related to said at least one dependent view; and

processing another one of said plurality of decoded video signals representing said base view using said at least one of said temporal and spatial image information related to said at least one dependent view to provide said processed video signal representing said base view.

6. The method of claim 1, wherein said processing said plurality of decoded video signals comprises:

processing at least one of said plurality of decoded video signals representing said at least one dependent view to provide image information related to said at least one dependent view; and

processing another one of said plurality of decoded video signals representing said base view using said image information related to said at least one dependent view to provide said processed video signal representing said base view.

7. An apparatus including a video system for providing a single view video signal based on a multiview video coding (MVC) signal stream, comprising:

a decoder adapted to decode a MVC signal stream representing a plurality of spatially related views of a scene, including a base view and at least one dependent view, to provide a plurality of decoded video signals representing said plurality of spatially related views; and

one or more video processors adapted to process said plurality of decoded video signals using image information from more than one of said plurality of decoded video signals to provide a processed video signal representing one of said plurality of spatially related views.

8. The apparatus of claim 7, wherein:

said MVC signal stream includes a bitstream corresponding to said base view and at least another bitstream corresponding to said at least one dependent view; and

said decoder is adapted to

decode said bitstream corresponding to said base view to provide one of said plurality of decoded video signals, and

decode said bitstream corresponding to said at least one dependent view to provide at least another one of said plurality of decoded video signals.

9. The apparatus of claim 7, wherein:

said MVC signal stream includes a bitstream of which a first portion corresponds to said base view and of which at least a second portion corresponds to said at least one dependent view; and

said decoder is adapted to

decode said first portion of said bitstream to provide one of said plurality of decoded video signals, and

decode said at least a second portion of said bitstream to provide at least another one of said plurality of decoded video signals.

10. The apparatus of claim 7, wherein:

respective portions of said MVC signal stream include respective temporal image information corresponding to one of a plurality of temporally adjacent video frames;

respective portions of said MVC signal stream include respective spatial image information corresponding to one of a plurality of sequences of spatially adjacent video frames; and

said one or more video processors are adapted to process said plurality of decoded video signals using at least one of said temporal and spatial image information.

11. The apparatus of claim 10, wherein said one or more video processors are adapted to:

process at least one of said plurality of decoded video signals representing said at least one dependent view to provide said at least one of said temporal and spatial image information related to said at least one dependent view; and

process another one of said plurality of decoded video signals representing said base view using said at least one of said temporal and spatial image information related to said at least one dependent view to provide said processed video signal representing said base view.

12. The apparatus of claim 7, wherein said one or more video processors are adapted to:

process at least one of said plurality of decoded video signals representing said at least one dependent view to provide image information related to said at least one dependent view; and

process another one of said plurality of decoded video signals representing said base view using said image information related to said at least one dependent view to provide said processed video signal representing said base view.

13. A computer readable medium comprising a plurality of executable instructions that, when executed by an integrated circuit design system, cause the integrated circuit design system to produce at least one integrated circuit (IC) for providing a single view video signal based on a multiview video coding (MVC) signal stream and including:

a decoder adapted to decode a MVC signal stream representing a plurality of spatially related views of a scene, including a base view and at least one dependent view, to provide a plurality of decoded video signals representing said plurality of spatially related views; and

one or more video processors adapted to process said plurality of decoded video signals using image information from more than one of said plurality of decoded video signals to provide a processed video signal representing one of said plurality of spatially related views.

14. The computer readable medium of claim 13, wherein:

said MVC signal stream includes a bitstream corresponding to said base view and at least another bitstream corresponding to said at least one dependent view; and

said decoder is adapted to

decode said bitstream corresponding to said base view to provide one of said plurality of decoded video signals, and

decode said bitstream corresponding to said at least one dependent view to provide at least another one of said plurality of decoded video signals.

15. The computer readable medium of claim 13, wherein:

said MVC signal stream includes a bitstream of which a first portion corresponds to said base view and of which at least a second portion corresponds to said at least one dependent view; and

said decoder is adapted to

decode said first portion of said bitstream to provide one of said plurality of decoded video signals, and

decode said at least a second portion of said bitstream to provide at least another one of said plurality of decoded video signals.

16. The computer readable medium of claim 13, wherein:

respective portions of said MVC signal stream include respective temporal image information corresponding to one of a plurality of temporally adjacent video frames;

respective portions of said MVC signal stream include respective spatial image information corresponding to one of a plurality of sequences of spatially adjacent video frames; and

said one or more video processors are adapted to process said plurality of decoded video signals using at least one of said temporal and spatial image information.

17. The computer readable medium of claim 16, wherein said one or more video processors are adapted to:

process at least one of said plurality of decoded video signals representing said at least one dependent view to provide said at least one of said temporal and spatial image information related to said at least one dependent view; and

process another one of said plurality of decoded video signals representing said base view using said at least one of said temporal and spatial image information related to said at least one dependent view to provide said processed video signal representing said base view.

18. The computer readable medium of claim 13, wherein said one or more video processors are adapted to:

process at least one of said plurality of decoded video signals representing said at least one dependent view to provide image information related to said at least one dependent view; and

process another one of said plurality of decoded video signals representing said base view using said image information related to said at least one dependent view to provide said processed video signal representing said base view.