Stereoscopic image format with depth information

• US 8,482,654 B2
• Filed: 10/26/2009
• Issued: 07/09/2013
• Est. Priority Date: 10/24/2008
• Status: Active Grant

• Current Assignee: RealD Incorporated
• Original Assignee: RealD Incorporated
• Inventors: Lipton, Lenny, Robinson, Michael G., Akka, Robert
• Primary Examiner(s): Shin, Kyung H
• Application Number:
  US12/606,121
• Publication Number:
  US 20100103249A1
• Time in Patent Office: 1,352 Days
• Field of Search: 348/340, 348/51, 348/E13.075, 348/E13.007, 382/154
• US Class Current: 348/340
• CPC Class Codes: G03H 2210/42 from real object, e.g. using 3D scanner
• CPC Class Codes: G03H 2210/441 Numerical processing applied to the object data other than numerical propagation
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/183 On-screen display [OSD] information, e.g. subtitles or menus
• CPC Class Codes: H04N 2213/003 Aspects relating to the "2D+depth" image format
• CPC Class Codes: H04N 2213/005 Aspects relating to the "3D+depth" image format

Abstract

A multi-view distribution format is described for stereoscopic and autostereoscopic 3D displays. In general, it comprises multi-tile image compression with the inclusion of one or more depth maps. More specifically, it provides embodiments that utilize stereoscopic images with one or more depth maps typically in the form of a compressed grey scale image and, in some instances, incorporates depth information from a second view encoded differentially.

Claims

1. A method for providing image data for a three dimensional image, the method comprising:

receiving left and right eye image data and depth information associated with the three dimensional image;

determining, based on the left and right eye image data and depth information, three dimensional image data, wherein the three dimensional image data comprises at least one left image view and one right image view and at least one image disparity map, each of the at least one image disparity map being associated with either the left image view or the right image view; and

encoding the at least one left image view and one right image view and the at least one image disparity map.

2. The method of claim 1, further comprising:

transmitting the three dimensional image data.

3. The method of claim 1, further comprising compressing the at least one left image view and one right image view and the at least one image disparity map.

4. The method of claim 1, wherein the encoding the at least one left image view and one right image view and the at least one image disparity map comprises:

using the at least one left image view and one right image view to generate two disparity maps, each of the two disparity maps associated with either the left image view or the right image view.

5. The method of claim 1, wherein the encoding the at least one left image view and one right image view and the at least one image disparity map comprises:

using the at least one left image view and one right image view and the at least one image disparity map to generate a second image disparity map.

6. The method of claim 5, further comprising:

comparing the second image disparity map to the at least one image disparity map;

recording differences between the second image disparity map and the at least one image disparity map;

storing the differences in a differential disparity map.

7. The method of claim 1, wherein the determining at least one image disparity map comprises determining two image disparity maps.

8. The method of claim 1, wherein the determining at least one image disparity map comprises determining a central view disparity map.

9. The method of claim 1, wherein the determining at least one image disparity map comprises determining a non-central view disparity map.

10. The method of claim 1, wherein the determining at least one image disparity map comprises determining two image disparity maps.

11. The method of claim 1, further comprising:

storing temporarily, in machine memory, the at least two image views and the at least one image disparity map.

12. A method for handling image data for a three dimensional image, the method comprising:

receiving three dimensional image data, wherein the three dimensional image data is determined based on left and right eye image data and depth information, and comprises at least one left image view and one right image view and at least one image disparity map, each of the at least one image disparity map being associated with either the left image view or the right image view;

decoding the three dimensional image data.

13. The method of claim 12, wherein the decoding comprises:

calculating a generated view'"'"'s disparity values by;

using a first of the at least one left image view and one right image view and the generated view'"'"'s disparity values and generating mapped right-eye data;

using a second of the at least one left image view and one right image view and the generated view'"'"'s disparity values and generating mapped left-eye data;

calculating the weighted average of the mapped right-eye data and the mapped left-eye data; and

generating an image view.

14. The method of claim 13, further comprising filling voids in the weighted average of the mapped right-eye data and the mapped left-eye data.

15. The method of claim 12, wherein the decoding the image data comprises:

one of demultiplexing or decompressing a data stream, the data stream comprising data representative of the at least one left image view and one right image view and the at least one image disparity map;

revealing data, the data comprising;

a first of the at least one left image view and one right image view;

a first disparity map associated with the first of the at least one left image view and one right image view;

a differential disparity map associated with the second of the at least one left image view and one right image view; and

a differential view associated with the differential disparity map;

generating an estimated view, the estimated view associated with the second of the at least one left image view and one right image view;

using the estimated view and the differential view to generate the second of the at least one left image view and one right image;

using the first and second of the at least one left image view and one right image view with the first disparity map to generate an estimated second-view disparity map;

using the estimated second-view disparity map with the second of the at least one left image view and one right image view to determine a second disparity map; and

using the at least one left image view and one right image view and the at least one disparity map to generate views of a scene.

16. The method of claim 12, wherein the receiving the image data comprises receiving a left eye view and a right eye view and two image disparity maps.

17. The method of claim 12, wherein the receiving the image data comprises receiving a left eye view and a right eye view and a central view disparity map.

18. The method of claim 12, wherein the receiving the image data comprises receiving a non-central view disparity map.

19. The method of claim 12, wherein the receiving the image data comprises receiving two disparity maps.

20. The method of claim 12, further comprising:

storing temporarily, in machine memory, the image data.

21. The method of claim 12, further comprising:

displaying the three-dimensional image on a stereo display.

22. The method of claim 12, further comprising:

displaying a plurality of views of the three-dimensional image on an autostereo display.