3D video encoding and decoding methods and apparatus
First Claim
1. A method of processing stereoscopic image data including a left eye image and a right eye image of a first frame pair, comprising:
- comparing the left eye image and right eye images of the first frame pair to determine a left eye image shift and a right eye image shift which can reduce a difference between the left eye image and right eye image of the first frame pair;
generating a scaled and cropped left eye image based on the left eye image shift determined by said comparing;
generating a scaled and cropped right eye image based on the right eye image shift determined by said comparing;
encoding said scaled and cropped left eye image and said scaled and cropped right eye image using an encoder which performs difference encoding on at least one of said scaled and cropped left and right eye images using the other one of said scaled and cropped left and right eye images as a reference image to generate encoded image data; and
storing transform information with said encoded image data, said transform information providing scaling and shift information relating to the encoded image data.
9 Assignments
0 Petitions
Accused Products
Abstract
Methods and apparatus relating to encoding and decoding stereoscopic (3D) image data, e.g., left and right eye images, are described. Various pre-encoding and post-decoding operations are described in conjunction with difference based encoding and decoding techniques. In some embodiments left and right eye image data is subject to scaling, transform operation(s) and cropping prior to encoding. In addition, in some embodiments decoded left and right eye image data is subject to scaling, transform operations(s) and filling operations prior to being output to a display device. Transform information and/or scaling information may be included in a bitstream communicating encoded left and right eye images. The amount of scaling can be the same for an entire scene and/or program.
45 Citations
20 Claims
-
1. A method of processing stereoscopic image data including a left eye image and a right eye image of a first frame pair, comprising:
-
comparing the left eye image and right eye images of the first frame pair to determine a left eye image shift and a right eye image shift which can reduce a difference between the left eye image and right eye image of the first frame pair; generating a scaled and cropped left eye image based on the left eye image shift determined by said comparing; generating a scaled and cropped right eye image based on the right eye image shift determined by said comparing; encoding said scaled and cropped left eye image and said scaled and cropped right eye image using an encoder which performs difference encoding on at least one of said scaled and cropped left and right eye images using the other one of said scaled and cropped left and right eye images as a reference image to generate encoded image data; and storing transform information with said encoded image data, said transform information providing scaling and shift information relating to the encoded image data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An apparatus including a processor configured to process stereoscopic image data including a left eye image and a right eye image of a first frame pair, said processor being configured to:
-
compare the left eye image and right eye images of the first frame pair to determine a left eye image shift and a right eye image shift which can reduce a difference between the left eye image and right eye image of the first frame pair; generate a scaled and cropped left eye image based on the left eye image shift determined by said comparing; generate a scaled and cropped right eye image based on the right eye image shift determined by said comparing, encode said scaled and cropped left eye image and said scaled and cropped right eye image using an encoder which performs difference encoding on at least one of said scaled and cropped left and right eye images using the other one of said scaled and cropped left and right eye images as a reference image to generate encoded image data; and store transform information with said encoded image data, said transform information providing scaling and shift information relating to the encoded image data.
-
-
11. A method comprising:
-
receiving i) encoded stereoscopic image data including an encoded left eye image of a frame pair which was generated by performing difference encoding on a pair of images including at least one of a scaled and cropped left eye image and a scaled and cropped right eye image using the other one of said scaled and cropped left eye image and scaled and cropped right eye image as a reference image and ii) transform information providing scaling and shift information relating to the encoded image data which provides information on a shift operation performed prior to encoding to reduce a difference between the pair of images prior to encoding; decoding said encoded left eye image to produce a decoded left eye image; scaling said decoded left eye image by an amount based on the scaling information included in said received transform information to generate a scaled decoded left eye image; and performing an inverse left eye transform on said scaled decoded left eye image based on at least some of said received transform information to generate a left eye output image, wherein performing an inverse left eye transform includes performing a first fill operation. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18)
-
-
19. An apparatus comprising a processor configured to:
-
receive i) encoded stereoscopic image data including an encoded left eye image of a frame pair which was generated by performing difference encoding on a pair of images including at least one of a scaled and cropped left eye image and a scaled and cropped right eye image using the other one of said scaled and cropped left eye image and scaled and cropped right eye image as a reference image and ii) transform information providing scaling and shift information relating to the encoded image data which provides information on a shift operation performed prior to encoding to reduce a difference between the pair of images prior to encoding; decode said encoded left eye image to produce a decoded left eye image; scale said decoded left eye image to generate a scaled decoded left eye image which is smaller than the decoded left eye image by an amount based on the scaling information included in said received transform information; and perform an inverse left eye transform on said scaled decoded left eye image based on at least some of said received transform information to generate a left eye output image, wherein performing an inverse left eye transform includes performing a first fill operation.
-
-
20. An apparatus configured to process encoded stereoscopic image data including an encoded left eye image of a frame pair, the apparatus comprising:
-
a receiver configured to receive i) encoded stereoscopic image data including an encoded left eye image of a frame pair which was generated by performing difference encoding on a pair of images including at least one of a scaled and cropped left eye image and a scaled and cropped right eye image using the other one of said scaled and cropped left eye image and scaled and cropped right eye image as a reference image and ii) transform information providing scaling and shift information relating to the encoded image data which provides information on a shift operation performed prior to encoding to reduce a difference between the pair of images prior to encoding; a first decoder configured to decode said encoded left eye image to produce a decoded left eye image; a first scaling module configured to scale said decoded left eye image to generate a scaled decoded left eye image of a smaller size than said decoded left eye image by an amount based on the scaling information included in said received transform information; and a first inverse transform module configured to perform an inverse left eye transform on said scaled decoded left eye image based on at least some of said received transform information to generate a left eye output image, wherein said first inverse transform module includes a first fill module configured to perform a first fill operation.
-
Specification