Optical system and method for remotely manipulating interactive graphical elements on television screens and the like

• US 6,252,720 B1
• Filed: 08/20/1999
• Issued: 06/26/2001
• Est. Priority Date: 08/20/1999
• Status: Expired due to Term

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Haseltine, Eric C.
• Primary Examiner(s): Epps, Georgia
• Assistant Examiner(s): THOMPSON, TIMOTHY J
• Application Number:
  US09/378,000
• Time in Patent Office: 676 Days
• Field of Search: 359/635, 359/637, 359/630, 434/85, 434/84, 108/9, 108/10
• US Class Current: 359/635
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence

Abstract

An optical virtual touch pad system wherein reflective optics are used to superimpose a virtual image of a television screen display onto a touch-sensitive digitizing surface being operatively contacted by a user-controlled contact member. Alternatively, the system uses reflective optics to superimpose an uninverted virtual image of the digitizing surface and the contact member operating thereon onto the surface of the display. The system thereby, for example, can be used as a user interface to control interactive content on a home television.

Claims

1. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface; and

a beamsplitter positioned to optically superimpose a virtual image of the digitizing surface on the display screen.

2. The system of claim 1 wherein the digitizing surface includes resistive transducers, surface acoustic wave transducers, capacitive transducers or piezo-electric sensors.

3. The system of claim 1 wherein the computer is a set-top box.

7. The system of claim 1 wherein the contact member is a pointer unit, a writing instrument, a finger of the person or a hand of the person.

4. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

optical means for optically superimposing on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image through the optical means.

5. The system of claim 4 wherein the digitizing surface includes resistive transducers, surface acoustic wave transducers, capacitive transducers or piezo-electric sensors.

6. The system of claim 4 further comprising a computer operatively connected to the display screen and to the digitizing surface.

8. The system of claim 4 wherein the optical means include a beamsplitter and forming means for forming a virtual magnified image of the digitizing surface which is reflected by the beamsplitter to lie in a plane of the display screen.

9. The system of claim 4 wherein the optical means includes a beamsplitter and superimposing means for superimposing an uninverted, magnified virtual image of the digitizing surface on a plane of the display screen when viewed by the person through the beamsplitter.

10. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

a beamsplitter system which optically superimposes on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image.

11. The system of claim 10 wherein the digitizing surface includes resistive transducers, surface acoustic wave transducers, capacitive transducers or piezo-electric sensors.

12. The system of claim 10 wherein the contact member is a pointer unit, a writing instrument or a finger of the person.

13. The system of claim 10 further comprising a computer operatively connected to the display screen and to the digitizing surface.

14. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a beamsplitter system which optically superimposes on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactible with a contact member by a person generally positioned to view the virtual image.

15. The system of claim 14 wherein the digitizing surface includes resistive transducers, surface acoustic wave transducers, capacitive transducers or piezo-electric sensors.

16. The system of claim 14 further comprising a computer operatively connected to the display screen and to the digitizing surface.

17. The system of claim 14 wherein the contact member is a pointer unit, a writing instrument, a finger of the person or a hand of the person.

18. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image.

19. The system of claim 18 wherein the digitizing surface includes resistive transducers, surface acoustic waver transducers, capacitive transducers or piezo-electric sensors.

20. The system of claim 18 further comprising a computer operatively connected to the display screen and to the digitizing surface.

21. The system of claim 18 wherein the contact member is a pointer unit, a writing instrument, a finger of the person or a hand of the person.

22. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface; and

a beamsplitter positioned to optically superimpose a virtual image of an electronic display of the display screen on the digitizing surface.

23. The system of claim 22 wherein the digitizing surface includes resistive transducers, surface acoustic waver transducers, capacitive transducers or piezo-electric sensors.

24. The system of claim 22 wherein the computer is set-top box.

25. A system, comprising:

a display screen;

a digitizing surface operatively connected to the display screen;

an optical element which produces a virtual image of the digitizing surface; and

a beamsplitter which superimposes the virtual image onto the display screen.

26. The system of claim 25 wherein the optical element is a positive mirror.

27. The system of claim 25 wherein the optical element is a positive lens.

28. The system of claim 25 further comprising a set-top box operatively connected to the digitizing surface and the display screen.

29. The system of claim 25 wherein the display screen is a television screen.

30. The system of claim 25 wherein the distance of the positive optical element from the beamsplitter is adjustable to position the virtual image at the same distance from the beamsplitter as the screen is from the beamsplitter.

31. The system of claim 25 wherein the virtual image includes a virtual image of a contact member manipulated relative to the digitizing surface by the person viewing through the beamsplitter the superimposed virtual image on the display screen.

32. The system of claim 31 wherein the contact member includes a portion of a hand of the user.

33. A method, comprising the steps of:

providing a screen having an electronic display;

providing a digitizing surface spaced from the screen;

using reflective optics, superimposing a virtual image of the electronic display on the digitizing surface; and

while viewing the superimposed virtual image, operatively contacting with a contact member a portion of the digitizing surface and relative to the superimposed virtual image.

34. The method of claim 33 wherein the virtual image is registered with the digitizing surface.

35. The method of claim 33 wherein the screen is an interactive television screen which is operatively connected to a set-top box.

36. The method of claim 33 wherein the portion defines a first surface portion, and the digitizing surface includes a second surface portion generally spaced from the first surface portion, a first touch-sensitive sensor at the first surface portion and a second touch-sensitive sensor at the second surface portion.

37. A method, comprising the steps of:

providing a screen having an electronic display;

providing a digitizing surface spaced from the screen;

operatively contacting with a contact member a portion of the digitizing surface;

using reflective optics, superimposing virtual images of the contact member and of the digitizing surface on the screen; and

the operatively contacting step being while viewing the electronic display and the virtual images.

38. The method of claim 37 wherein the virtual image of the digitizing surface is registered with the electronic display.

39. The method of claim 37 wherein the portion defines a first surface portion, and the digitizing surface includes a second surface portion generally spaced from the first surface portion, a first touch-sensitive sensor at the first surface portion and a second touch-sensitive sensor at the second surface portion.

40. The method of claim 37 wherein the screen is an interactive television screen which is operatively connected to a set-top box.

41. A method, comprising the steps of:

manipulating a contact member relative to a digitizing surface, which is operatively connected to a display screen; and

during the manipulating step, viewing a virtual image of the contact member superimposed on the display screen.

42. The method of claim 41 wherein the virtual element is produced by a positive optical element and the viewing is through a beamsplitter.

43. The method of claim 42 further comprising adjusting the distance of the positive optical element from the beamsplitter to be the same distance as from the beamsplitter to the display screen.

44. The method of claim 41 wherein optical elements are used to align the virtual image.

45. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of the digitizing surface on the display screen.

46. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface; and

a beamsplitter positioned to optically superimpose a virtual image of the digitizing surface on the display screen;

wherein the display screen is an interactive television screen.

47. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of the digitizing surface on the display screen; and

a front surface mirror positioned in an optical path between the display screen and the digitizing surface.

48. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of the digitizing surface on the display screen; and

a positive mirror positioned to form a virtual magnified image of the digitizing surface which is reflected by the beamsplitter to lie in a plane of the display screen.

49. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of the digitizing surface on the display screen; and

a front surface mirror and a positive optical element between the digitizing surface and the front surface mirror.

50. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

optical means for optically superimposing on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image through the optical means;

wherein the display screen is an interactive television screen.

51. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

optical means for optically superimposing on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image through the optical means;

wherein the optical means includes a beamsplitter and correcting means for optically correcting inversion of a virtual image formed by the beamsplitter.

52. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

optical means for optically superimposing on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image through the optical means;

wherein the correcting means includes a front surface mirror.

53. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen;

optical means for optically superimposing on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image through the optical means;

wherein the optical means include a beamsplitter and forming means for forming a virtual magnified image of the digitizing surface which is reflected by the beamsplitter to lie in a plane of the display screen; and

wherein the forming means includes a concave mirror or a positive Fresnel mirror.

54. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

optical means for optically superimposing on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image through the optical means;

wherein the optical means includes a beamsplitter and superimposing means for superimposing an uninverted, magnified virtual image of the digitizing surface on a plane of the display screen when viewed by the person through the beamsplitter; and

wherein the superimposing means includes a front surface mirror and a positive optical element between the digitizing surface and the front surface mirror.

55. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

a beamsplitter system which optically superimposes on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image;

wherein the display screen is an interactive television screen.

56. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

a beamsplitter system which optically superimposes on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image;

wherein the beamsplitter system includes a beamsplitter and a front surface mirror which corrects virtual image inversion of the beamsplitter.

57. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

a beamsplitter system which optically superimposes on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image;

wherein the beamsplitter system includes a beamsplitter and a positive mirror which forms an image of the digitizing surface, the image being reflected by the beamsplitter to lie in a plane of the display screen.

58. A system, comprising:

a touch-sensitive digitizing surface having an operative surface portion;

a display screen; and

a beamsplitter system which optically superimposes on an electronic display of the display screen a virtual image of the digitizing surface and of a contact member manipulated relative to the operative surface portion by a person generally as the person views the virtual image;

wherein the beamsplitter system includes a front surface mirror, a beamsplitter between the display screen and the front surface mirror and a positive optical element between the front surface mirror and the digitizing surface.

59. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a beamsplitter system which optically superimposes on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactible with a contact member by a person generally positioned to view the virtual image;

wherein the display screen is an interactive television screen.

60. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a beamsplitter system which optically superimposes on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactible with a contact member by a person generally positioned to view the virtual image;

wherein the beamsplitter system includes a beamsplitter and a front surface mirror which corrects virtual image inversion of the beamsplitter.

61. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a beamsplitter system which optically superimposes on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactible with a contact member by a person generally positioned to view the virtual image;

wherein the beamsplitter system includes a partially reflective beamsplitter and a partially-reflective convex mirror between the partially reflective beamsplitter and the digitizing surface.

62. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a beamsplitter system which optically superimposes on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactible with a contact member by a person generally positioned to view the virtual image;

wherein the beamsplitter system includes a partially reflective beamsplitter and a front surface convex mirror at a right angle to a view of the person of the digitizing surface through the beamsplitter.

63. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a beamsplitter system which optically superimposes on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactible with a contact member by a person generally positioned to view the virtual image;

wherein the beamsplitter system includes a front surface mirror, a negative lens between the display screen and the front surface mirror and a beamsplitter between the front surface mirror and the digitizing surface.

64. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a beamsplitter system which optically superimposes on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactible with a contact member by a person generally positioned to view the virtual image;

wherein the beamsplitter system includes a beamsplitter and a positive optical element between the beamsplitter and the digitizing surface.

65. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the display screen is an interactive television screen.

66. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes a beamsplitter and correcting means for optically correcting inversion of a virtual image formed by the beamsplitter.

67. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image;

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes a beamsplitter and correcting means for optically correcting inversion of a virtual image formed by the beamsplitter; and

wherein the correcting means includes a front surface mirror in an optical path between the display screen and the digitizing surface.

68. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes a partially reflective beamsplitter and forming means optically associated with the beamsplitter for forming an erect virtual image of the electronic display.

69. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image;

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes a partially reflective beamsplitter and forming means optically associated with the beamsplitter for forming an erect virtual image of the electronic display; and

wherein the forming means includes a partially-reflective convex mirror between the beamsplitter and the digitizing surface.

70. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes a partially reflective beamsplitter and the virtual image is an uninverted virtual image of the electronic display.

71. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image;

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes a partially reflective beamsplitter and the virtual image is an uninverted virtual image of the electronic display; and

wherein the optical means includes a front surface, convex mirror at a right angle to a view of the person of the digitizing surface.

72. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes forming means for forming a first virtual image of the electronic display, superimposing means for superimposing the first virtual image onto the digitizing surface and reflecting means for reflecting the first virtual image from the forming means to the superimposing means.

73. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image;

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes forming means for forming a first virtual image of the electronic display, superimposing means for superimposing the first virtual image onto the digitizing surface and reflecting means for reflecting the first virtual image from the forming means to the superimposing means; and

wherein the forming means is a negative lens, the superimposing means is a beamsplitter and the reflecting means is a front surface mirror.

74. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image; and

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes forming means for forming a virtual magnified image of the digitizing surface in the same plane as the virtual image of the electronic display.

75. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

optical means for optically superimposing on the digitizing surface a virtual image of an electronic display of the display screen;

the surface including a surface portion thereof corresponding to at least a portion of the virtual image;

the surface portion being operatively contactable with a contact member by a person positioned generally to view the virtual image;

wherein the optical means includes forming means for forming a virtual magnified image of the digitizing surface in the same plane as the virtual image of the electronic display; and

wherein the optical means includes a beamsplitter and the forming means includes a positive lens between the beamsplitter and the digitizing surface.

76. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface; and

a beamsplitter positioned to optically superimpose a virtual image of an electronic display of the display screen on the digitizing surface;

wherein the display screen is an interactive television screen.

77. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of an electronic display of the display screen on the digitizing surface; and

a front surface mirror positioned in an optical path between the display screen and the digitizing surface.

78. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface; and

a beamsplitter positioned to optically superimpose a virtual image of an electronic display of the display screen on the digitizing surface

wherein the beamsplitter is a partially reflective beamsplitter, and further comprising a partially-reflective convex mirror between the partially reflective beamsplitter and the digitizing surface.

79. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of an electronic display of the display screen on the digitizing surface; and

a negative mirror in line with a first optical path from the display screen to the beamsplitter, wherein the first optical path is perpendicular to a second optical path from the beamsplitter to the digitizing surface.

80. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of an electronic display of the display screen on the digitizing surface; and

a front surface mirror in an optical path between the display screen and the beamsplitter and a negative lens between the display screen and the front surface mirror.

81. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of an electronic display of the display screen on the digitizing surface; and

a positive lens between the beamsplitter and the digitizing surface.

82. A system, comprising:

a display screen;

a touch-sensitive digitizing surface;

a computer operatively connected to the display screen and to the digitizing surface;

a beamsplitter positioned to optically superimpose a virtual image of an electronic display of the display screen on the digitizing surface; and

a front surface mirror operatively between the display screen and the beamsplitter.