Method and apparatus for generating a stereoscopic image

• US 7,557,824 B2
• Filed: 12/17/2004
• Issued: 07/07/2009
• Est. Priority Date: 12/18/2003
• Status: Active Grant

• Current Assignee: RealD Incorporated
• Original Assignee: University of Durham
• Inventors: Holliman, Nicolas S.
• Primary Examiner(s): Bali; Vikkram
• Assistant Examiner(s): Bitar; Nancy
• Application Number:
  US10/596,536
• Publication Number:
  US 20070247522A1
• Time in Patent Office: 1,663 Days
• Field of Search: 348/46, 348/51, 348/44, 382/128, 345419-627
• US Class Current: 348/46
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems

Abstract

A method of generating a stereoscopic image is disclosed. The method includes defining at least two, three or more regions in a scene representing a region of interest, a near regions and/or a far region. This is followed by forming an image pair for each region, this image pair containing the information relating to objects in or partially in their respective region. The perceived depth within the regions is altered to provide the ideai or best perceived depth within the region of interest and acceptable or more compressed perceived depths in the other regions. The image pairs are then mapped together to form a display image pair for viewing on a display device.

Claims

1. A method of generating a stereoscopic image of a scene, the method comprising:

defining a first region of the scene;

forming a first image pair, wherein the first image pair comprises;

a first image of a first part of the first region as perceived from a first location; and

a second image of the first part of the first region as perceived from a second location;

wherein the second location is spaced from the first location by a first offset distance;

performing a first mapping process on the first image pair to generate a first part of a display image pair;

defining a second region of the scene;

forming a second image pair, wherein the second image pair comprises;

a third image of a second part of the second region as perceived from a third location; and

a fourth image of the second part of the second region as perceived from a fourth location;

wherein the fourth location is spaced from the third location by a second offset distance; and

further wherein the first and second offset distances are different;

performing a second mapping process on the second image pair to generate a second part of the display image pair; and

combining the first part of the display image pair and the second part of the display image pair to form a combined display image pair, said combined display image pair being adapted to provide a stereoscopic image of the first and second regions of the scene, wherein an object having a predetermined depth in a viewing direction in the first region has a first perceived depth and a second object having the predetermined depth in a second viewing direction in the second region has a second perceived depth, the second perceived depth having a perceived displacement from the first perceived depth.

2. A method according to claim 1 further comprising:

defining a third region of the scene;

forming a third image pair, wherein the third image pair comprises;

a fifth image of a third part of the third region as perceived from a fifth location;

and a sixth image of a third part of the third region as perceived from a sixth location;

wherein the sixth location is spaced from the fifth location by a third offset distance, and further wherein the first and third offset distances are different;

performing a third mapping process on the third image pair to generate a third part of the display image pair; and

combining the third part of the display image pair with the combined display image pairs to form a second combined display image pair, the second combined display image pair being adapted to provide a stereoscopic image of the first, second and third regions of the scene, wherein a third object having the predetermined depth in a third viewing direction in the third region has a third perceived depth, the third perceived depth having a perceived displacement from at least the first perceived depth.

3. A method according to claim 1, wherein the scene is real.

4. A method according to claim 1, wherein the first, second, third and fourth locations are located in a plane.

5. A method according to claim 1, wherein the first and second regions are defined by their distance from at least one of the first, second, third and fourth locations.

6. A method according to claim 1, wherein the first perceived depth is determined by the distance between the first and second locations;

and wherein

the second perceived depth is determined by the distance between the third and fourth locations.

7. A method according to claim 1, further comprising:

dividing the first image pair into a plurality of image pair elements;

dividing the second image pair into a second plurality of image pair elements;

determining the distance in the scene of each of the plurality of the image pair elements from a position between the first and second locations to determine which of the first and second regions each element is in; and

determining the distance in the scene of each of the second plurality of the image pair elements from a position between the third and fourth locations, to determine which of the first and second regions each element is in.

8. A method according to claim 7, further comprising:

discarding any of the plurality of image pair elements not from the first region; and

discarding any of the second plurality of image pair elements not from the second region.

9. An apparatus for generating a stereoscopic image of a scene, the apparatus comprising:

a first image forming device for forming a first image pair, wherein the first image pair comprises;

a first image of a first part of the first region as perceived from a first location; and

a second image of a first part of the first region as perceived from a second location;

wherein the second location is spaced from the first location by a first offset distance;

a first mapping device for performing a first mapping process on the first image pair to generate a first part of a display image pair;

a second image forming device for forming a second image pair, wherein the second image pair comprises;

a third image of a second part of the second region as perceived from a third location; and

a fourth image of a second part of the second region as perceived from a fourth location;

wherein the fourth location is spaced from the third location by a second offset distance; and

further wherein the first and second offset distances are different; and

a second mapping device for performing a second mapping process on the second image pair to generate a second part of a display image pair; and

a first image combining device for combining the first part of the display image pair and the second part of the display image pair to form a combined display image pair, said combined display image pair being adapted to provide a stereoscopic image of the first and second regions of the scene, wherein an object having a predetermined depth in a viewing direction in the first region has a first perceived depth and a second object having the predetermined depth in a second viewing direction in the second region has a second perceived depth, the second perceived depth having a perceived displacement from the first perceived depth.

10. An apparatus according to claim 9 further comprising:

a third image forming device for forming a third image pair, wherein the third image pair comprises;

a fifth image of a third part of the third region as perceived from a fifth location; and

a sixth image of a third part of the third region as perceived from a sixth location;

wherein the fifth location is spaced from the sixth location by a third offset distance; and

further wherein the first and third offset distances are different; and

a third mapping device for performing a third mapping process on the third image pair to generate a third part of a display image pair; and

a second image combining device for combining the combined display image pair and the third part of the display image pair to form a second combined display image pair, said second combined display image pair being adapted to provide a stereoscopic image of the first, second and third regions of the scene, wherein an object having a predetermined depth in a viewing direction in the first region has a first perceived depth and a second object having the predetermined depth in a second viewing direction in the second region has a second perceived depth and wherein a third object having the predetermined depth in a third viewing direction in the third region has a third perceived depth, the third perceived depth having a perceived displacement from the first perceived depth.

11. An apparatus according to claim 9, wherein the scene is real.

12. An apparatus according to claim 11, wherein at least one of the first image forming device and the second image forming device comprises a camera.

13. An apparatus according to claim 11, wherein at least one of the first mapping device, the second mapping device, and the imaging combining device comprises a computing device.

14. An apparatus according to claim 9, wherein the scene is simulated.