3D video encoding and decoding methods and apparatus
First Claim
1. A method of processing stereoscopic image data including a left eye image and a right eye image of a first frame pair, comprising:
- comparing content of said left eye image and said right eye image of the first frame pair to determine a first image shift which can be used to reduce a difference between the left eye image and right eye image;
performing transform operations on said left eye image and said right eye image to reduce the difference between the left eye image and right eye image, said transform operations including scaling said left and right eye images by a first amount to generate scaled left and right eye images, cropping said scaled left eye image to generate a cropped scaled left eye image including scaled content shifted in a first direction relative to a center of the left eye image, and cropping said scaled right eye image to generate a cropped scaled right eye image including scaled content shifted in a second direction relative to a center of the right eye image;
encoding said cropped scaled left eye image and cropped scaled right eye image to generate a first encoded frame pair, wherein encoding said cropped scaled left eye image and cropped scaled right eye image includes using an encoder which performs difference encoding on at least one of said cropped scaled left and right eye images using the other one of said cropped scaled left and right eye images as a reference image; and
communicating information to a playback device, with said first encoded frame pair, indicating said first amount of scaling.
9 Assignments
0 Petitions
Accused Products
Abstract
Methods and apparatus relating to encoding and decoding stereoscopic (3D) image data, e.g., left and right eye images, are described. Various pre-encoding and post-decoding operations are described in conjunction with difference based encoding and decoding techniques. In some embodiments left and right eye image data is subject to scaling, transform operation(s) and cropping prior to encoding. In addition, in some embodiments decoded left and right eye image data is subject to scaling, transform operations(s) and cropping prior to being output to a display device. Transform information, scaling information and/or cropping information may be included in a bitstream communicating encoded left and right eye images. The amount of scaling can be the same for an entire scene and/or program.
-
Citations
18 Claims
-
1. A method of processing stereoscopic image data including a left eye image and a right eye image of a first frame pair, comprising:
-
comparing content of said left eye image and said right eye image of the first frame pair to determine a first image shift which can be used to reduce a difference between the left eye image and right eye image; performing transform operations on said left eye image and said right eye image to reduce the difference between the left eye image and right eye image, said transform operations including scaling said left and right eye images by a first amount to generate scaled left and right eye images, cropping said scaled left eye image to generate a cropped scaled left eye image including scaled content shifted in a first direction relative to a center of the left eye image, and cropping said scaled right eye image to generate a cropped scaled right eye image including scaled content shifted in a second direction relative to a center of the right eye image; encoding said cropped scaled left eye image and cropped scaled right eye image to generate a first encoded frame pair, wherein encoding said cropped scaled left eye image and cropped scaled right eye image includes using an encoder which performs difference encoding on at least one of said cropped scaled left and right eye images using the other one of said cropped scaled left and right eye images as a reference image; and communicating information to a playback device, with said first encoded frame pair, indicating said first amount of scaling. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 15, 16, 17)
-
-
11. A method of processing encoded stereoscopic image data including an encoded left eye image and an encoded right eye image of a frame pair, comprising:
-
decoding said encoded left and right eye images to produce decoded left and right eye images, said encoded left and right eye images having been encoded using difference encoding on at least one of a left eye image and a right eye image using the other one of the left and right eye images as a reference image, said left and right eye images having been produced by transform operations including scaling said left and right eye images to generate scaled left and right eye images, cropping said scaled left eye image to generate a cropped scaled left eye image including scaled content shifted in a first direction and cropping said scaled right eye image to generate a cropped scaled right eye image including scaled content shifted in a second direction, to reduce a difference between the left and right eye images, said second direction being opposite to said first direction; scaling said decoded left and right eye images by a first amount indicated to a playback device by information supplied to said playback device along with said encoded left eye image and said encoded right eye image or prior to said encoded left and right eye images being supplied to said playback device; cropping said scaled decoded left and right eye images, said cropping of said scaled decoded left and right eye images producing a cropped scaled decoded left eye image including scaled content shifted relative to the center of the decoded left eye image and a cropped scaled decoded right eye image including scaled content shifted relative to the center of the decoded right eye image; and outputting said cropped scaled decoded left eye image and right eye image. - View Dependent Claims (12, 13, 14)
-
-
18. An apparatus including a processor configured to process stereoscopic image data including a left eye image and a right eye image of a first frame pair, said processor being configured to:
-
compare content of said left eye image and said right eye image of the first frame pair to determine a first image shift which can be used to reduce a difference between the left eye image and right eye image; perform transform operations on said left eye image and said right eye image to reduce the difference between the left eye image and right eye image, said transform operations including scaling said left and eye right images by a first amount to generate scaled left and right eye images, cropping said scaled left eye image to generate a cropped scaled left eye image including scaled content shifted in a first direction relative to a center of the left eye image, and cropping said scaled right eye image to generate a cropped scaled right eye image including scaled content shifted in a second direction relative to a center of the right eye image; encode said cropped scaled left eye image and cropped scaled right eye image to generate a first encoded frame pair, wherein encoding said cropped scaled left eye image and cropped scaled right eye image includes using an encoder which performs difference encoding on at least one of said cropped scaled left and right eye images using the other one of said cropped scaled left and right eye images as a reference image; and communicate information to a playback device, with said first encoded frame pair, indicating said first amount of scaling.
-
Specification