Virtual data entry device and method for input of alphanumeric and other data

• US 20060101349A1
• Filed: 12/21/2005
• Published: 05/11/2006
• Est. Priority Date: 05/29/2000
• Status: Active Grant

• Current Assignee: Amichai Turm, Boas Arnon, Eyal Naimi, Klony Lieberman, Mattan Tsachi, Yaniv Maor, Yuval Sharon
• Original Assignee: Amichai Turm, Boas Arnon, Eyal Naimi, Klony Lieberman, Mattan Tsachi, Yaniv Maor, Yuval Sharon
• Inventors: Sharon, Yuval, Maor, Yaniv, Naimi, Eyal, Lieberman, Klony, Tsachi, Mattan, Turm, Amichai, Arnon, Boas
• Granted Patent: US 7,305,368 B2
• Time in Patent Office: Days
• US Class Current: 715/773
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886
• CPC Class Codes: Y10S 706/908 Electronic or computer, internal or network, circuit

Abstract

A data input device including an optically generated image of a data input device, the image including at least one input zone actuable by an action performed thereon by a user, a sensor operative to sense the action performed on the at least one input zone, and to generate signals in response to the action, and a processor in communication with the sensor operative to process the signals for performing an operation associated with the at least one input zone.

Claims

1. Apparatus for inputting at least alpha-numeric information into a computer comprising:

a projector, projecting an image of at least part of a keyboard onto an inert surface;

a single two dimensional sensor comprising at least one infrared illuminator generating a generally planar beam generally parallel to said inert surface and also comprising an array of discrete sensing elements and at least one lens operative to image a region overlying each of a plurality of keyboard locations onto a corresponding at least one of said array of discrete sensing elements, said single two dimensional sensor sensing user indicator interaction with specific locations on said image of at least part of a keyboard; and

at least alpha-numeric information generation circuitry employing an output from said single two dimensional sensor for providing an at least alpha-numeric output.

2. Apparatus according to claim 1 and also comprising a wireless communicator operative to provide said at least alpha-numeric output in a wireless manner to a receiver.

3. Apparatus according to claim 2 and wherein said wireless communicator comprises a cellular telephone.

4. Apparatus according to claim 3 and wherein said cellular telephone includes a housing, in which housing are mounted said projector, said single two dimensional sensor and said at least alpha-numeric information generation circuitry.

5. Apparatus according to claim 1 and also comprising a personal digital assistant.

6. Apparatus according to claim 5 and wherein said personal digital assistant includes a housing, in which housing are mounted said projector, said single two dimensional sensor and said at least alpha-numeric information generation circuitry.

7. Apparatus according to claim 1 and wherein said at least one infrared illuminator is operative to direct infrared radiation over said image of at least part of a keyboard and said single two dimensional sensor also comprises at least one infrared sensor for sensing infrared light scattered from at least one user indicator.

8. Apparatus according to claim 2 and wherein said at least one infrared illuminator is operative to direct infrared radiation over said image of at least part of a keyboard and said single two dimensional sensor also comprises at least one infrared sensor for sensing infrared light scattered from at least one user indicator.

9. Apparatus according to claim 3 and wherein said single two dimensional sensor comprises at least one visible light illuminator, directing visible radiation over said image of at least part of a keyboard onto an inert surface and at least one visible radiation sensor for sensing visible light scattered from at least one user indicator.

10. Apparatus according to claim 4 and wherein said single two dimensional sensor comprises at least one visible light illuminator, directing visible radiation over said image of at least part of a keyboard onto an inert surface and at least one visible radiation sensor for sensing visible light reflected from at least one user indicator.

11. Apparatus according to claim 1 and wherein said user indicator is a user finger.

12. Apparatus according to claim 1 and wherein said user indicator is a user held stylus.

13. Apparatus according to claim 1 and wherein said projector comprises a point light source illuminating a mask defining said image of at least part of a keyboard.

14. Apparatus according to claim 13 and also comprising a mirror directing light passing through said mask onto said inert surface.

15. Apparatus according to claim 13 and also comprising at least one lens directly receiving light from said point light source through said mask.

16. Apparatus according to claim 13 and wherein said point light source comprises a diode laser.

17. Apparatus according to claim 13 and wherein said mask is formed to define a distorted representation of said image of at least part of a keyboard in order to compensate for distortions in said projector.

18. Apparatus according to claim 13 and wherein said mask is a dynamically changeable mask.

19. Apparatus according to claim 1 and wherein said infrared illuminator comprises a cylindrical reflecting element receiving light from a point source and producing a generally flat, generally radially-directed light distribution.

20. Apparatus according to claim 8 and wherein said infrared illuminator comprises a cylindrical reflecting element receiving light from a point source and producing a generally flat, generally radially-directed light distribution.

21. Apparatus according to claim 9 and wherein said visible light illuminator comprises a cylindrical reflecting element receiving light from a point source and producing a generally flat, generally radially-directed light distribution.

22. Apparatus according to claim 10 and wherein said visible light illuminator comprises a cylindrical reflecting element receiving light from a point source and producing a generally flat, generally radially-directed light distribution.

24. Apparatus according to claim 1 and wherein said single two dimensional sensor comprises a position sensitive detector and at least one lens operative to image a region overlying each of a plurality of keyboard locations onto a corresponding region on said position sensitive detector.

25. Apparatus according to claim 7 and wherein said at least one infrared illuminator is operative to direct infrared radiation at a plurality of levels over said image of at least part of a keyboard and said at least one infrared sensor is operative to sense infrared light scattered from at least one user indicator at a plurality of locations therealong.

26. Apparatus according to claim 8 and wherein said at least one infrared illuminator is operative to direct infrared radiation at a plurality of levels over said image of at least part of a keyboard and said at least one infrared sensor is operative to sense infrared light reflected from at least one user indicator at a plurality of locations therealong.

27. Apparatus according to claim 9 and wherein said at least one visible light illuminator is operative to direct visible radiation at a plurality of levels over said image of at least part of a keyboard and said at least one visible radiation sensor is operative to sense visible radiation light scattered from at least one user indicator at a plurality of locations therealong.

28. Apparatus according to claim 10 and wherein said at least one visible light illuminator is operative to direct visible radiation at a plurality of levels over said image of at least part of a keyboard and said at least one visible radiation sensor is operative to sense visible radiation light reflected from at least one user indicator at a plurality of locations therealong.

29. Apparatus according to claim 1 and wherein said projector comprises a diffractive optical element, which when illuminated produces said image of at least part of a keyboard onto said inert surface.

30. Apparatus according to claim 1 and wherein said projector comprises a spatial light modulator, which when illuminated produces said image of at least part of a keyboard onto said inert surface.

31. Apparatus according to claim 30 and wherein said spatial light modulator comprises a dynamic spatial light modulator which is responsive to an electrical input for producing a dynamic image onto said inert surface.

32. Apparatus according to claim 1 and wherein:

said projector projects an image of at least part of a keyboard and of mouse functionality onto said inert surface; and

said single two dimensional sensor senses user indicator interaction with specific locations on said image of said mouse functionality.

81. Apparatus for inputting at least alpha-numeric information into a computer according to claim 1 and wherein said projector comprises a solid state light source which illuminates, via a negative lens, a mask which defines said image of at least part of a keyboard and also defines a mouse functionality including a touchpad and a pair of click buttons, said projector also comprising a mirror which directs light from said mask onto said inert surface.

82. Apparatus for inputting at least alpha-numeric information into a computer according to claim 81 and wherein said solid state light source comprises a diode laser light source having natural astigmatism which obviates a need for a condensing lens upstream of said mask and said mask is pre-distorted in order to compensate for optical distortions in projection.

83. Apparatus for inputting at least alpha-numeric information into a computer according to claim 82 and wherein said infrared illuminator comprises a solid state light source which directs light via a focusing lens and a mirror onto a cylindrical reflecting element which products radially directed illumination about a longitudinal axis of said cylindrical reflecting element and extends over 180 degrees, generally in a plane generally parallel to said inert surface, said radially directed illumination being characterized in that it has a relatively narrow spread in a direction generally perpendicular to said inert surface.

84. Apparatus for inputting at least alpha-numeric information into a computer according to claim 83 and wherein said mask comprises a dynamic mask comprising a spatial light modulator.

85. Apparatus for inputting at least alpha-numeric information into a computer according to claim 84 and wherein said illuminator comprises a line light source and a scanning mirror which reflects a line of light produced by said line light source in a direction generally perpendicular to the plane of said inert surface.

23. (canceled)

33-48. -48. (canceled)

49. A method for inputting at least alpha-numeric information into a computer comprising:

projecting an image of at least part of a keyboard onto an inert surface;

employing a single two dimensional sensor comprising at least one infrared illuminator generating a generally planar beam generally parallel to said inert surface and also comprising an array of discrete sensing elements and at least one lens for sensing user indicator interaction with specific locations on said image of at least part of a keyboard and imaging a region overlying each of a plurality of keyboard locations onto a corresponding at least one of said array of discrete sensing elements; and

employing an output indicating sensed user indicator interaction for providing an at least alpha-numeric output.

50. A method according to claim 49 and also comprising providing said at least alpha-numeric output in a wireless manner to a receiver.

51. A method according to claim 49 and wherein said sensing comprises directing infrared radiation over said image of at least part of a keyboard on an inert surface and sensing infrared light scattered from at least one user indicator.

52. A method according to claim 49 and wherein said sensing comprises directing visible radiation over said image of at least part of a keyboard on an inert surface and sensing visible light scattered from at least one user indicator.

53. A method according to claim 49 and wherein said user indicator is a user finger.

54. A method according to claim 49 and wherein said user indicator is a user held stylus.

55. A method according to claim 51 and wherein said directing comprises reflecting light from a point source and producing a generally flat, generally radially-directed light distribution.

56. A method according to claim 52 and wherein said directing comprises reflecting light from a point source and producing a generally flat, generally radially-directed light distribution.

58. A method according to claim 49 and wherein said sensing comprises position sensitive detecting and imaging of a region overlying each of a plurality of keyboard locations onto a corresponding region on a position sensing detector.

59. A method according to claim 51 and wherein said directing includes directing infrared radiation at a plurality of levels over said image of at least part of a keyboard and said infrared sensing includes sensing infrared light scattered from at least one user indicator at a plurality of locations therealong.

60. A method according to claim 52 and wherein said directing includes directing visible radiation at a plurality of levels over said image of at least part of a keyboard and said visible sensing includes sensing visible light scattered from at least one user indicator at a plurality of locations therealong.

61. A method according to claim 49 and wherein said projecting comprises illuminating a diffractive optical element to produce said image of at least part of a keyboard onto said inert surface.

62. A method according to claim 49 and wherein said projecting comprises illuminating a spatial light modulator to produce said image of at least part of a keyboard onto said inert surface.

63. A method according to claim 62 and wherein said projecting comprises illuminating a dynamic spatial light modulator which is responsive to an electrical input for producing a dynamic image onto said inert surface.

79. A method according to claim 49 and wherein:

said projecting projects an image of at least part of a keyboard and of mouse functionality onto said inert surface; and

said sensing senses user indicator interaction with specific locations on said image of said mouse functionality.

57. (canceled)

64-78. -78. (canceled)

80. (canceled)