System for rendering virtual see-through scenes

• US 20100110069A1
• Filed: 10/31/2008
• Published: 05/06/2010
• Est. Priority Date: 10/31/2008
• Status: Abandoned Application

• Current Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Yuan, Chang
• Application Number:
  US12/290,585
• Publication Number:
  US 20100110069A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 15/20 Perspective computation

Abstract

A system for displaying an image on a display includes a display for displaying an image thereon. A three dimensional representation of an image is obtained. The three dimensional representation is rendered as a two dimensional representation on the display. An imaging device is associated with the display. The location of a viewer is determined with respect to the display. The rendering on the display is based upon the determining the location of the viewer with respect to the display.

Claims

1. A method for displaying an image on a display comprising:

(a) providing said display for displaying an image thereon;

(b) providing a three dimensional representation of an image;

(c) rendering said three dimensional representation as a two dimensional representation on said display;

(d) providing an imaging device associated with said display;

(e) determining the location and the orientation of viewing of a viewer with respect to said display;

(f) modifying said rendering on said display based upon said determining the location of said viewer with respect to said display.

2. The method of claim 1 wherein said modifying results in said viewer observing two dimensional motion parallax.

3. The method of claim 1 wherein said location includes the viewer'"'"'s head position.

4. The method of claim 1 wherein said location includes the viewer'"'"'s eye position.

5. The method of claim 1 further comprising providing a plurality of imaging devices associated with said display used for said determining.

6. The method of claim 4 wherein said orientation includes the location of a gaze of said viewer.

7. The method of claim 1 wherein said three dimensional representation is generated from the input of a two dimensional representation.

8. The method of claim 7 wherein said three dimensional representation is created from said two dimensional representation based upon a visual media content independent technique.

9. The method of claim 7 wherein said three dimensional representation is created from said two dimensional representation based upon a visual media content dependent technique.

10. The method of claim 1 wherein said modifying is based upon the viewer'"'"'s head position.

11. The method of claim 1 wherein said rendering is based upon the convergence of a plurality of optical rays.

12. The method of claim 1 wherein said three dimensional image is based upon receiving a two dimensional image.

13. The method of claim 12 wherein said two dimensional image is at least one of a video, a text, a vector graphic, a drawing.

14. The method of claim 13 wherein said three dimensional image is at least one of graphics, scientific data, and a gaming environment.

15. The method of claim 14 wherein said three dimensional image includes at least one of a structure including points, a surface, a solid object, a planar surface, a cylindrical surface, a spherical surface, a surface described by a parametric equation, and a surface described by a non-parametric equation.

16. The method of claim 1 wherein said rendering is modified based upon a viewer'"'"'s field of view.

17. The method of claim 15 wherein said three dimensional image is rendered by a graphics processing unit.

18. The method of claim 1 wherein said three dimensional representation further includes live feed information content.

19. The method of claim 1 wherein said three dimensional representation further includes free viewpoint video.

20. The method of claim 1 wherein the color and luminance of said two dimensional representation is based upon the color and luminance of said three dimensional representation.

21. The display of claim 1 wherein said display is flat.

22. The display of claim 1 wherein said display is not flat.

23. The display of claim 1 wherein said display includes a plurality of panels.

24. The display of claim 23 wherein each of said plurality of panels are flat.

25. The display of claim 1 wherein the color of said two dimensional representation is based upon tracing optical rays into said three dimensional representation and sampling colors from said three dimensional representation.

26. The display of claim 1 wherein said display includes a plurality of panels and each of said panels are calibrated.

27. The display of claim 26 wherein said calibration for each of said panels is independent of another of said panels.

28. The display of claim 26 wherein said calibration includes brightness and color.

29. The display of claim 23 wherein said panels are at an angle between zero and 180 degrees with respect to one another.

30. The display of claim 1 wherein said determining said location is based upon a plurality of viewers.

31. The display of claim 1 wherein said display is concave.

32. The display of claim 1 wherein said display is convex.

33. The display of claim 1 wherein said imaging device includes an infra-red imaging device.

34. The display of claim 33 further comprising said imaging device sensing at least one of primarily infra-red reflecting markers and infra-red emitting lights.

35. The display of claim 34 wherein said imaging device includes an infra-red lighting device.

36. The display of claim 34 further comprising interpreting a pattern of sensed infra-red reflecting markers.

37. The display of claim 36 wherein said pattern is representative of an alphanumeric character.

38. The display of claim 36 wherein said pattern is representative of a distance.

39. The display of claim 38 wherein said distance is used for tracking.

40. The display of claim 1 further comprising tracking a movement of said viewer.

41. The display of claim 40 wherein said tracking includes 3D translation.

42. The display of claim 40 wherein said tracking includes 3D rotation.

43. The display of claim 40 wherein said movement has 3 degrees of freedom.

44. The display of claim 40 wherein said movement has 2 degrees of freedom.

45. The display of claim 40 wherein said movement has 6 degrees of freedom.

46. The display of claim 1 wherein said rendering is based upon a viewing point and a look at point.

47. The display of claim 46 wherein when said look at point moves one direction the scene moves in the opposite direction.

48. The display of claim 46 wherein said display includes motion parallax.

49. The display of claim 46 wherein said rendering is based upon perspective projection parameters.

50. The display of claim 1 wherein said rendering is performed in a single graphics processing unit.

51. The display of claim 1 wherein said rendering is performed by a plurality of graphics processing units.

52. The display of claim 50 wherein said rendered image is displayed on a single display.

53. The display of claim 50 wherein said rendered image is displayed on a plurality of displays.

54. The display of claim 53 wherein each of said plurality of displays includes an associated graphics processing unit that does not render said image.

55. The display of claim 51 wherein said rendered image is displayed on a single display.

56. The display of claim 51 wherein said rendered image is displayed on a plurality of displays.

57. The display of claim 56 wherein each of said plurality of displays includes an associated graphics processing unit that does not render said image.

58. The display of claim 34 wherein a viewer is tracked when the viewer is wearing a marker.

59. The display of claim 34 wherein a viewer is tracked when the viewer is wearing multiple markers.

60. The display of claim 40 wherein said movement is determined based upon temporal filtering.

61. The display of claim 60 wherein said filtering includes a Kalman filter.

62. The display of claim 1 wherein said rendering is based upon a viewing point that moves in the same direction as that of the viewer'"'"'s movement.

63. The display of claim 1 wherein said rendering results in a different view of view based upon viewer movement.

64. The display of claim 48 wherein said motion parallax is based upon sensing viewer movement.