Method for producing a synthesized stereoscopic image

• US RE39,342 E1
• Filed: 08/22/2002
• Issued: 10/17/2006
• Est. Priority Date: 08/30/1996
• Status: Expired due to Term

• Current Assignee: Phoenix 3D, Inc.
• Original Assignee: For3D, Inc.
• Inventors: Starks, Michael, Shulman, Alan
• Primary Examiner(s): Lefkowitz, Sumati
• Assistant Examiner(s): HARRISON, CHANTE E
• Application Number:
  US10/226,807
• Time in Patent Office: 1,517 Days
• Field of Search: 345/419, 345/629, 345/473, 345/647, 345/8, 345/649, 345/9, 345/121, 345/653, 345/660, 345/654, 345/665, 345/672, 345/679, 345/680, 348/42, 348/56, 348/51, 348/47, 382/118
• US Class Current: 345/419
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/00193 adapted for stereoscopic vision
• CPC Class Codes: G02B 27/2207 stereoscopic devices based on anaglyph techniques
• CPC Class Codes: G02B 27/2264 involving time multiplexing, e.g. using sequentially activated left and right shutters
• CPC Class Codes: G02B 27/26 involving polarising means
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/218 using spatial multiplexing
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/344 : with head-mounted left-right displays
• CPC Class Codes: H04N 13/398 : Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 19/597 : specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2013/0081 : Depth or disparity estimation from stereoscopic image signals

Abstract

Methods, devices and systems are provided which produce a synthesized stereoscopic image of a source image by forming at least two images from a source image where at least one image has been modified relative to the source image such that the images have a different spacial appearance than each other. A wide variety of modifications may be made to the source object in order to form modified stereo images. These modifications may involve modifying one or more images relative to the source image. For example, at least one image may be magnified, reduced, or rotated in the X, Y and/or Z plane relative to the source image. Alternatively or in addition, the position of one or more elements of one of the images may also be changed relative to the source image. Alternatively or in addition, at least one of the images may be transformed relative to the source image using a function which alters the position of elements of the image along the X or Y axis relative to the source image. In one variation, the function is a distorting algorithm, for example an elliptical or aspheric distorting algorithm which is not dependent on the depth information of the source image.

Claims

1. A method for producing a synthesized stereoscopic image of a source image comprising:

displaying at least two images which

when viewed in combination form the synthesized stereoscopic image of the source image,

do not simulate how a physical three dimensional model of the source image would independently appear to a left eye and a right eye of an observer, and

include one image which differs from another of the at least two images such that at least a portion of the one image is magnified, reduced, rotated, displaced in a vertical direction, or modified such that a position of one or more elements of that image relative to other elements of that image is different than relative positionings of the corresponding elements in another of the at least two images.

2. The method according to claim 1, wherein the step of displaying the at least two images includes transmitting the image signals encoding the at least two images to an image display.

3. The method according to claim 2 wherein at least one of the image signals is an analog signal.

4. The method according to claim 2 wherein at least one of the image signals is a digital signal.

5. The method according to claim 2, wherein the image signals are transmitted to the image display by a device which converts recorded data encoding the at least two images into the image signals.

6. The method according to claim 2, wherein the image signals are transmitted to the image display by a device which converts a signal encoding the source image into the image signals.

7. The method according to claim 6, wherein converting the signal encoding the source image into the image signals is performed by the device in real time.

8. The method according to claim 1, wherein only one image of the at least two images is modified relative to the source image.

9. The method according to claim 1, wherein at least two of the at least two images are modified relative to the source image.

10. The method according to claim 1, wherein one of the at least two images is magnified or reduced relative to another of the at least two images.

11. The method according to claim 1, wherein one of the at least two images is rotated in the X and/or Y and/or Z plane relative to another of the at least two images.

12. The method according to claim 1, wherein images for a given eye are displayed at a frequency that is greater than the frequency at which that eye can perceive individual images.

13. The method according to claim 1, wherein a position of one or more elements of one of the at least two images relative to other elements of that image is different than relative positionings of the corresponding elements in another of the at least two images.

14. The method according to claim 1, wherein at least one of the at least two images is transformed relative to the source image using a function which alters the position of elements of the image along the Y axis.

15. The method according to claim 1, wherein wherein at least one of the at least two images is transformed relative to the source image using a function which is a distorting algorithm.

16. The method according to claim 1, wherein at least one of the at least two images is transformed relative to the source image using a function which is an elliptical or aspheric algorithm.

17. The method according to claim 1, wherein at least one of the at least two images is transformed relative to the source image using a function which is nonlinear along at least one of the X and Y axes.

41. The method according to claim 1, wherein at least one of the at least two images is transformed relative to the source image using a function which alters the position of elements of the image along the X axis.

42. The method according to claim 1, wherein some or all of at least one of the at least two images is transformed relative to the source image based on speed of motion.

43. The method according to claim 1, further comprising the step of determining the position of each of the one or more elements of that image relative to other elements of that image based on variable delay.

44. The method according to claim 43, wherein determining the position of each of the one or more elements of the transformed image relative to other elements of that image based on variable delay comprises:

determining the position of any one of the one or more elements of the transformed image based on the speed of motion of that one element.

45. The method according to claim 43, wherein determining the position of each of the one or more elements of the transformed image relative to other elements of that image based on variable delay comprises:

determining the position of any one of the one or more elements of the transformed image based on a functions of the relative speed of one or more of the objects and or background of the image.

46. The method according to claim 1, wherein the position of the one or more elements of that image are determined based on encoding information.

47. The method according to claim 46, wherein the encoding information comprises information obtained while encoding the image signals.

18. A method for viewing a synthesized stereoscopic image comprising:

displaying a source image on an image display; and

viewing the source image through stereo viewing glasses, the stereo viewing glasses having left and right lenses, at least one of the lenses modifying the source image to produce at least two images which

when viewed in combination form the synthesized stereoscopic image of the source image,

do not simulate how a physical three dimensional model of the source image would independently appear to a left eye and a right eye of an observer, and

include one image which differs from another of the at least two images such that at least a portion of the one image is magnified, reduced, rotated displaced in a vertical direction, or modified such that a position of one or more elements of that image relative to other elements of that image is different than relative positionings of the corresponding elements in another of the at least two images.

19. The method according to claim 18, wherein modifying the source image to produce the at least two images is performed in real time.

20. The method according to claim 18, wherein only one of the at least two images is modified relative to the source image.

21. The method according to claim 18, wherein at least two of the at least two images are modified relative to the source image.

22. The method according to claim 18, wherein one of the at least two images is magnified or reduced relative to another of the at least two images.

23. The method according to claim 18, wherein one of the at least two images is rotated in the X and/or Y and/or Z plane relative to another of the at least two images.

24. The method according to claim 18, wherein images for a given eye are displayed at a frequency that is greater than the frequency at which that eye can perceive individual images.

25. The method according to claim 18, wherein a position of one or more elements of one of the at least two images relative to other elements of that image is different than relative positionings of the corresponding elements in another of the at least two images.

26. The method according to claim 18, wherein at least one of the at least two images is transformed relative to the source image using a function which alters the position of elements of the image along the Y axis.

27. The method according to claim 18, wherein at least one of the at least two images is transformed relative to the source image using a function which is nonlinear along at least one of the X and Y axes.

48. The method according to claim 18, wherein at least one of the at least two images is transformed relative to the source image using a function which alters the position of elements of the image along the X axis.

49. The method according to claim 18, wherein some or all of at least one of the at least two images is transformed relative to the source image based on speed of motion.

50. The method according to claim 18, further comprising the step of determining the position of each of the one or more elements of that image relative to other elements of that image based on variable delay.

51. The method according to claim 50, wherein determining the position of each of the one or more elements of that image relative to other elements of that image based on variable delay comprises:

determining the position of any one of the one or more elements of that image based on the speed of motion of that one element.

52. The method according to claim 50, wherein determining the position of each of the one or more elements of the transformed image relative to other elements of that image based on variable delay comprises:

determining the position of any one of the one or more elements of the transformed image based on a functions of the relative speed of one or more of the objects and or background of the image.

53. The method according to claim 18, wherein the position of the one or more elements of that image are determined based on encoding information.

54. The method according to claim 53, wherein the encoding information comprises information obtained while encoding the image signals.

28. A method for synthesizing stereoscopic image from a source image comprising:

taking a signal encoding a source image and forming at least two image signals encoding the source image;

modifying at least one of the image signals such that the image signals encode at least two images which

when viewed in combination form the synthesized stereoscopic image of the source image,

do not simulate how a physical three dimensional model of the source image would independently appear to a left eye and a right eye of an observer, and

include one image which differs from another of the at least two images such that at least a portion of the one image is magnified, reduced, rotated, displaced in a vertical direction, or modified such that a position of one or more elements of that image relative to other elements of that image is different than relative positionings of the corresponding elements in another of the at least two images; and

displaying on an image display the at least two images encoded by the modified image signals.

29. The method according to claim 28, wherein modifying at least one of the image signals is performed in real time.

30. The method according to claim 28 wherein the modification of the source image involves a signal conversion selected from the group consisting of digital to digital, digital to analog, analog to digital and analog to analog.

31. The method according to claim 28, wherein only one of the at least two images is modified relative to the source image.

32. The method according to claim 28, wherein at least two of the at least two images are modified relative to the source image.

33. The method according to claim 28, wherein one of the at least two images is magnified or reduced relative to another of the at least two images.

34. The method according to claim 28, wherein one of the at least two images is rotated in the X and/or Y and/or Z plane relative to another of the at least two images.

35. The method according to claim 28, wherein a position of one or more elements of one of the at least two images relative to other elements of that image is different than relative positionings of the corresponding elements in another of the at least two images.

36. The method according to claim 28, wherein at least one of the at least two images is transformed relative to the source image using a function which alters the position of elements of the transformed image along the Y axis.

37. The method according to claim 28, wherein at least one of the it least two images is transformed relative to the source image using a function which is nonlinear along at least one of the X and Y axes.

38. The method according to claim 28, wherein wherein at least one of the at least two images is transformed relative to the source image using a function which is a distorting algorithm.

39. The method according to claim 28, wherein at least one of the at least two images is transformed relative to the source image using a function which is an elliptical or aspheric algorithm.

40. The method according to claim 28 wherein at least one of the at least two images includes a horizontal or vertical shift relative to the source image.

55. The method according to claim 28, wherein at least one of the at least two images is transformed relative to the source image using a function which alters the position of elements of the image along the X axis.

56. The method according to claim 28, wherein some or all of at least one of the at least two images is transformed relative to the source image based on speed of motion.

57. The method according to claim 28, further comprising the step of determining the position of each of the one or more elements of that image relative to other elements of that image based on variable delay.

58. The method according to claim 55, wherein determining the position of each of the one or more elements of that image relative to other elements of that image based on variable delay comprises:

determining the position of any one of the one or more elements of that image based on the speed of motion of that one element.

59. The method according to claim 57, wherein determining the position of each of the one or more elements of the transformed image relative to other elements of that image based on variable delay comprises:

determining the position of any one of the one or more elements of the transformed image based on a functions of the relative speed of one or more of the objects and or background of the image.

60. The method according to claim 28, wherein the position of the one or more elements of that image are determined based on encoding information.

61. The method according to claim 60, wherein the encoding information comprises information obtained while encoding the image signals.