Directed interpolation and data post-processing
First Claim
1. A method for receiving an input video stream and encoding an output video stream with a signal indicative of a processing technique to be utilized on the output video stream, the method comprising:
- receiving an input video stream;
converting the format of the input video stream to comprise a multiplexed stream of two downsampled stereoscopic views of the input video stream, wherein the multiplexed stream comprises a checkerboard arrangement;
selecting non-predefined regions within the multiplexed stream wherein the selected regions are based upon a desired characteristic, said desired characteristic further comprising detected motion within the region and texture within the region;
encoding spatial-temporal metadata associated with the non-predefined regions, the metadata characterizing the spatial-temporal characteristics of the non-predefined regions;
filtering each selected region with a plurality of filters;
selecting a desired filter for each selected region based upon a selection criterion, said selection criterion further comprise at least one of motion detection for possible temporal filtering and texture analysis for spatial filtering;
encoding filter metadata regarding the selected filter for the non-predefined regions; and
embedding a signal, the signal based on the spatial-temporal metadata and filter metadata, into the output video stream, the signal identifies at least one of at least part of a decoding process to be applied to the output video stream.
1 Assignment
0 Petitions
Accused Products
Abstract
An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
56 Citations
22 Claims
-
1. A method for receiving an input video stream and encoding an output video stream with a signal indicative of a processing technique to be utilized on the output video stream, the method comprising:
-
receiving an input video stream; converting the format of the input video stream to comprise a multiplexed stream of two downsampled stereoscopic views of the input video stream, wherein the multiplexed stream comprises a checkerboard arrangement; selecting non-predefined regions within the multiplexed stream wherein the selected regions are based upon a desired characteristic, said desired characteristic further comprising detected motion within the region and texture within the region; encoding spatial-temporal metadata associated with the non-predefined regions, the metadata characterizing the spatial-temporal characteristics of the non-predefined regions; filtering each selected region with a plurality of filters; selecting a desired filter for each selected region based upon a selection criterion, said selection criterion further comprise at least one of motion detection for possible temporal filtering and texture analysis for spatial filtering; encoding filter metadata regarding the selected filter for the non-predefined regions; and embedding a signal, the signal based on the spatial-temporal metadata and filter metadata, into the output video stream, the signal identifies at least one of at least part of a decoding process to be applied to the output video stream. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A post-processing device, comprising:
-
a video input configured to receive a decoded video stream, the video stream comprising a plurality of video scenes, wherein further the video stream comprises a multiplexed stream of two downsampled stereoscopic views of the input video stream, wherein the multiplexed stream comprises a checkerboard arrangement; an instruction mechanism configured to one of accept a directive instruction from a side information channel of the video stream and identify a directive instruction from the decoded video stream; a post-processor configured to post-process the decoded video stream based on the directive instruction; and a video output configured to output the post-processed video stream, wherein the directive instruction comprises spatial-temporal metadata associated with at least one adaptively selected region in the video of arbitrary size, comprising information about at least the shape and size, detected motion and texture of the adaptively selected region, and filter metadata associated with a selected filter applied to at least one adaptively selected regions, the selected filter being selected among a plurality of filters wherein the selection is based upon a selection criterion, said selection criterion further comprise at least one of motion detection for possible temporal filtering and texture analysis for spatial filtering; and further wherein the decoded checkerboard multiplexed stream is processed back into a full resolution image. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22)
-
Specification