Stereoscopic display system with flexible rendering of disparity map according to the stereoscopic fusing capability of the observer

• US 20050190180A1
• Filed: 02/27/2004
• Published: 09/01/2005
• Est. Priority Date: 02/27/2004
• Status: Active Grant

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Eastman Kodak Company
• Inventors: Miller, Michael E., Cerosaletti, Cathleen D., Endrikhovski, Serguei, Jin, Elaine W.
• Granted Patent: US 8,094,927 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence

Abstract

A method is provided for customizing scene content, according to a user or a cluster of users, for a given stereoscopic display, including obtaining customization information about the user; obtaining a scene disparity map for a pair of given stereo images and/or a three-dimensional (3D) computer graphic model; and determining an aim disparity range for the user. The method of the present invention also generates a customized disparity map and/or rendering conditions for a three-dimensional (3D) computer graphic model correlating with the user'"'"'s fusing capability of the given stereoscopic display; and renders or re-renders the stereo images for subsequent display.

Claims

1. A method for customizing scene content, according to a user or a cluster of users, for a given stereoscopic display, comprising the steps of:

a) obtaining customization information about the user;

b) obtaining a scene disparity map for a pair of given stereo images and/or a three-dimensional (3D) computer graphic model;

c) determining an aim disparity range for the user;

d) generating a customized disparity map and/or rendering conditions for a three-dimensional (3D) computer graphic model correlating with the user'"'"'s fusing capability of the given stereoscopic display; and

e) applying the customized disparity map and/or rendering conditions for rendering or re-rendering the stereo images for subsequent display.

2. The method claimed in claim 1, wherein the customization information includes a user profile and/or a rendering intent subject to a predetermined task choice and/or skill level.

3. The method claimed in claim 1, further comprising the step of:

f) obtaining display attributes prior to determining the aim disparity range for the user.

4. The method claimed in claim 1, further comprising the step of:

f) displaying the stereo images compatible to the user'"'"'s capacity for fusing stereoscopic imagery.

5. The method claimed in claim 1, wherein the stereo images or 3D computer graphic model are obtained.

6. The method claimed in claim 1, wherein the scene disparity map is obtained for rendered stereo images.

7. The method claimed in claim 1, wherein a scene convergence point and depth information are obtained from the 3D computer graphics model.

8. The method claimed in claim 1, further comprising the step of:

f) determining a viewing distance of the user.

9. The method claimed in claim 1, wherein the step of generating a customized disparity map further includes using the scene disparity map for specific scene content and the aim disparity range according to the user in combination with a predetermined mapping function.

10. The method claimed in claim 9, wherein the predetermined mapping function is dependent on a region of interest.

11. The method claimed in claim 10, wherein the region of interest is dynamic.

12. The method claimed in claim 1, wherein the rendering intent can be dependent on skill of the user within a stereoscopic viewing environment.

13. The method claimed in claim 1, wherein the rendering intent correlates to a type of task that the user will perform in a stereoscopic viewing environment.

14. The method claimed in claim 1, wherein the step of generating the customized disparity map includes a re-mapping process.

15. The method claimed in claim 1, wherein the step of generating the customized disparity map is accomplished by applying a linear transformation to the scene disparity map.

16. The method claimed in claim 1, wherein the step of generating the customized disparity map is accomplished by applying a non-linear transformation to the scene disparity map.

17. The method claimed in claim 14, wherein a plurality of disparities in the scene disparity map are increased after re-mapping the customized disparity map.

18. The method claimed in claim 14, wherein a plurality of disparities in the scene disparity map are decreased after re-mapping the customized disparity map.

19. The method claimed in claim 10 wherein the region of interest is based upon a measurement of fixation position.

20. The method claimed in claim 10, wherein the region of interest is based upon a map of probable fixations.

21. The method claimed in claim 1, wherein the step of determining an aim disparity range undergoes a calculation based on parameters selected from the group consisting of a viewing distance for the user and the display attributes.

22. The method claimed in claim 1, wherein the step of generating rendering conditions for a three-dimensional (3D) computer graphic model includes computing a location, an orientation, a focal distance, a magnification and a depth of field correlating to a pair of simulated cameras.

23. The method claimed in claim 1, wherein the step of applying the rendering conditions involves modifying one or more of a set of correlating camera measurements that include camera location, orientation, focal distance, magnification and depth of field.

24. A method for determining an aim disparity range for stereoscopic imaging, comprising the steps of:

a) obtaining a stereoscopic display user'"'"'s identifier;

b) determining whether the stereoscopic display user has a user profile;

c) retrieving a found user profile for the stereoscopic display user;

d) creating the user profile where no existing user profile is found;

e) obtaining rendering intent correlating to the stereoscopic display user; and

f) calculating the aim disparity range subject to above steps.

25. The method for determining an aim disparity range as claimed in claim 24, further comprising the step of assigning values for skill level (C_s) of the stereoscopic display user and type of tasks (C_t) that the stereoscopic display user will perform.

26. The method for determining an aim disparity range as claimed in claim 24, further comprising the step of assigning a value, as an adaptive factor, C_a, for compensating for a dynamic viewing experience subject to the stereoscopic display user.

27. The method claimed in claim 24, wherein the user profile is created from the group consisting of on-display assessment, stored optometric data, and a default user profile.

28. The method claimed in claim 27, wherein the on-display assessment includes manipulating one or more test stimuli shown in a user interface for adjusting disparity between at least one target and the stereoscopic display user.

29. The method claimed in claim 27, wherein the on-display assessment includes automatic manipulation of one or more test stimuli shown in a user interface for adjusting disparity between at least one target and the stereoscopic display user.

30. The method claimed in claim 27, wherein creating the user profile includes the step of obtaining optometric parameters for a set of accommodation planes as the stored optometric data.

31. The method claimed in claim 30, wherein the step of obtaining optometric parameters includes selecting from the group consisting of inter-pupillary distance, near and distant testing distances, near and distant phoria, and near and distant fusional reserves.

32. The method claimed in claim 27, wherein the default user profile is determined using an optometric model.

33. The method claimed in claim 27, wherein the default user profile is determined using interpolation of a set of statistical data from an optometric assessment of the user population.

34. The method claimed in claim 30, further comprising the steps of:

a) generalizing the optometric parameters for a different set of accommodation planes;

b) calculating optometric parameters for a single accommodation plane of display;

c) obtaining comfort values for a user'"'"'s fusing capability; and

d) determining the aim disparity range based on the optometric parameters and above steps.

35. A stereoscopic display system customized for a user'"'"'s stereoscopic fusing capability, comprising:

a) a processor for processing images and/or rendering images;

b) an image source communicatively linked to the processor for supplying imagery to the processor;

c) a storage device communicatively linked to the processor for storing useful data that will enable the processor to process images and/or render images; and

d) a stereoscopic display device communicatively linked to the processor and driven by the processor to display stereo images.

36. The stereoscopic display system claimed in claim 35, wherein the useful data includes display attributes and/or customization information relevant to the user.

37. The stereoscopic display system claimed in claim 36, wherein the customization information relevant to the user includes rendering intent and/or a user profile.

38. The stereoscopic display system claimed in claim 35, further comprising:

e) an input device communicatively linked to the processor for providing input data and/or functions to the processor.

39. The stereoscopic display system claimed in claim 35, further comprising:

e) a sensor communicatively linked to the processor for providing sensory data and/or functions about the user to the processor.

40. The stereoscopic display system claimed in claim 35, wherein the sensory data includes head positioning, accommodative state of the user'"'"'s eye and direction of eye gaze of the user.

41. The stereoscopic display system claimed in claim 35, wherein the processor further comprises:

a) means for obtaining customization information about the user;

b) means for obtaining a scene disparity map for a pair of given stereo images and/or a three-dimensional (3D) computer graphic model;

c) means for determining an aim disparity range for the user;

d) means for generating a customized disparity map correlating with the user'"'"'s fusing capability of the given stereoscopic display; and

e) means for re-rendering the stereo images for subsequent display.

42. The stereoscopic display system claimed in claim 41, wherein the means for determining an aim disparity range for the user, includes:

a) means for obtaining a stereoscopic display user'"'"'s identifier;

b) means for determining whether the stereoscopic display user has a user profile;

c) means for retrieving a found user profile for the stereoscopic display user;

d) means for creating the user profile where no existing user profile is found;

e) means for obtaining rendering intent correlating to the stereoscopic display user;

f) means for assigning values for skill level (C_s) of the stereoscopic display user and type of tasks (C_t) that the stereoscopic display user will perform;

g) means for assigning a value, as an adaptive factor, C_a, for compensating for a dynamic viewing experience subject to the stereoscopic display user; and

h) means for calculating the aim disparity range subject to above steps.

43. A stereoscopic display system that determines an aim disparity range associated with a stereoscopic user, comprising:

a) means for determining aim disparity range based on optometric data, wherein said means further include;

b) means for obtaining optometric parameters for a set of accommodation planes;

c) means for generalizing the optometric parameters for a different set of accommodation planes;

d) means for calculating optometric parameters for a single accommodation plane of display;

e) means for obtaining comfort values for a user'"'"'s fusing capability; and

f) means for determining the aim disparity range based on the optometric parameters and above steps.

44. A user interface for obtaining the stereoscopic capabilities of a user, comprising:

one or more objects of known visual disparity displayed by the user interface.

45. The user interface in claim 44, wherein the user indicates their comfort when viewing the object.

46. The user interface in claim 44, wherein the user controls the known visual disparity of the one or more objects and indicates when they are unable to fuse one or more of the objects.

47. The user interface in claim 44, wherein the known visual disparity of the one or more objects is automatically updated and indicates to the user when the user is or is not able to fuse one or more of the objects.

48. The user interface in claim 44, wherein a series of objects of known visual disparity is displayed and the user indicates which of these the user is or is not able to fuse.

49. The user interface in claim 44, wherein an accommodation distance for one or more of the objects is different than an accommodation distance for one or more additional objects.

50. A software product capable of determining a range of stereo disparities that a user can fuse.

51. The software product as claimed in claim 50 capable of modifying rendering parameters within a computer application.

52. The software product as claimed in claim 51 capable of modifying the rendering parameters within a graphics rendering card.

53. A method for customizing a stereoscopic display according to a user or a cluster of users, comprising the steps of:

a) obtaining customization information about the user, wherein the customization information includes a user profile and/or a rendering intent subject to a predetermined task choice and/or skill level;

b) obtaining stereo images and/or three-dimensional computer graphic models;

c) obtaining a scene disparity map for the stereo images and/or the three-dimensional computer graphic models;

d) selecting a mode of determining an aim disparity range for the user;

e) determining the aim disparity range for the user;

f) generating a customized disparity map using the scene disparity map and the aim disparity range; and

g) re-rendering the stereo images for subsequent display.

54. A stereoscopic display system customized for a user'"'"'s stereoscopic fusing capability, comprising:

a) an image processor for processing images;

b) a rendering processor communicatively linked to the image processor for rendering images

c) an image source communicatively linked to the image processor for supplying imagery to the image processor;

d) a storage device communicatively linked to the image processor and the rendering processing for storing display attributes data that will enable the image processor and the rendering processor to process images and/or render images;

e) a storage device communicatively linked to the rendering processing for storing customization information that will enable the rendering processor to render images, and;

f) a stereoscopic display device communicatively linked to the rendering processor and driven by the rendering processor to display stereo images.

55. The stereoscopic display system claimed in claim 54, further comprising:

g) an input device communicatively linked to the image processor for providing input data and/or functions to the image processor.

56. The stereoscopic display system claimed in claim 54, further comprising:

g) a sensor communicatively linked to the rendering processor for providing sensory data and/or functions about the user to the rendering processor.

57. The stereoscopic display system claimed in claim 56, wherein the sensory data includes head positioning, accommodative state of the user'"'"'s eye and direction of eye gaze of the user.