Method And Device for Input Of Information Using Visible Touch Sensors

• US 20100103103A1
• Filed: 08/18/2009
• Published: 04/29/2010
• Est. Priority Date: 08/22/2008
• Status: Abandoned Application

• Current Assignee: DigiSight Technologies, Inc.
• Original Assignee: DigiSight Technologies, Inc.
• Inventors: Palanker, Daniel V., Blumenkranz, Mark S.
• Application Number:
  US12/543,368
• Publication Number:
  US 20100103103A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

A device and method for manual input of information into computing device using a camera and visible touch sensors. An image of a virtual input device is displayed on a screen, and the positions of the visible touch sensors, recorded by the video camera, are overlaid on the image of the virtual input device, thus allowing the user to see the placement of the touch sensors relative to the keys or buttons on the virtual input device. The touch sensors change their appearance upon contact with a surface, and the camera records their position at the moment of change. This way information about the position of intended touch is recorded. Touch sensors can be binary (ON-OFF) or may have a graded response reflecting the extent of displacement or pressure of the touch sensor relative to the surface of contact.

Claims

1. A system for operating a virtual input device using a surface, comprising:

a sensor configured to change a visible characteristic thereof in response to contacting a surface;

a camera for capturing an image of a field of view that includes the sensor;

a display for displaying a virtual input device;

at least one processor configured to;

determine from the captured image a relative location of the sensor within the field of view,

overlay onto the virtual input device a visual indicator of the sensor at a location on the display that corresponds to the determined relative location, and

determine from the image when the visible characteristic changes.

2. The system of claim 1, wherein the at least one processor is further configured to activate a portion of the virtual input device proximate to the visual indicator in response to the determined visible characteristic change.

3. The system of claim 2, wherein the portion of the virtual input device is one of a key, a button and a wheel displayed on the display.

4. The system of claim 2, wherein the virtual input device is one of a keyboard, a mouse and a touch pad.

5. The system of claim 2, wherein the sensor is further configured to gradually change the visible characteristic thereof in proportion to an amount of exerted pressure or displacement between the sensor and the surface.

6. The system of claim 5, wherein the at least one processor is further configured to gradually activate the portion of the virtual input device in proportion to the gradual change of the visible characteristic.

7. The system of claim 2, wherein the at least one processor is further configured to visually indicate on the display the activation of the portion of the virtual input device.

8. The system of claim 2, further comprising:

a plurality of reference markers disposed in the field of view and in the image captured by the camera, wherein the at least one processor is configured to determine from the captured image the relative location of the sensor using the reference markers.

9. The system of claim 1, wherein the sensor is configured as a ring for inserting over a user'"'"'s finger.

10. The system of claim 1, wherein the sensor comprises:

a detector for detecting contact of the sensor to the surface; and

a light source for emitting a light signal in response to the detecting by the detector, wherein the emitted light signal is the visible characteristic change of the sensor.

11. The system of claim 10, wherein the sensor further comprises:

a reflector for reflecting light, wherein the camera captures the reflected light as part of the image, and the at least one processor is configured to use the captured reflected light in determining the relative location of the sensor.

12. The system of claim 1, wherein the sensor comprises:

a compressible housing having a window portion; and

a spring configured to extend into the window portion upon compression of the housing, wherein the extension of the spring into the window portion is the visible characteristic change of the sensor.

13. The system of claim 1, wherein the sensor comprises:

a compressible reservoir containing fluid;

a transparent capillary extending from the reservoir, wherein the fluid flows into the capillary upon compression of the reservoir, and wherein the flow of the fluid into the capillary is the visible characteristic change of the sensor.

14. The system of claim 1, wherein the sensor is a plurality of sensors each of which includes a different color or pattern relative to the other sensors, and wherein the at least one processor is configured to activate different portions or functions of the virtual input device in dependence on the different colors or patterns of the sensors.

15. A method of operating a virtual input device using a surface, comprising:

placing sensor in a field of view of a camera, wherein the sensor is configured to change a visible characteristic thereof in response to contacting a surface;

contacting the sensor to the surface to change the visible characteristic;

capturing an image of a field of view using a camera;

displaying a virtual input device on a display;

determining from the captured image a relative location of the sensor within the field of view;

overlaying onto the virtual input device a visual indicator of the sensor at a location on the display that corresponds to the determined relative location;

determining from the image when the visible characteristic changes; and

activating a portion of the virtual input device proximate to the visual indicator in response to the determined visible characteristic change.

16. The method of claim 15, wherein the portion of the virtual input device is one of a key, a button and a wheel displayed on the display.

17. The method of claim 15, wherein the virtual input device is one of a keyboard, a mouse and a touch pad.

18. The method of claim 15, wherein:

the contacting includes applying a varying amount of exerted pressure or displacement between the sensor and the surface, wherein the sensor is further configured to gradually change the visible characteristic thereof in proportion to the varying amount of exerted pressure or displacement between the sensor and the surface; and

the activating includes gradually activating the portion of the virtual input device in proportion to the gradual change of the visible characteristic.

19. The method of claim 15, further comprising:

visually indicating on the display the activation of the portion of the virtual input device.

20. The method of claim 15, further comprising:

placing a plurality of reference markers in the field of view, wherein the determining from the captured image the relative location of the sensor within the field of view is performed using the reference markers.

21. The method of claim 15, wherein:

the sensor comprises a detector for detecting contact of the sensor to the surface and a light source for emitting a light signal in response to the detecting by the detector; and

the determining from the image when the visible characteristic changes includes detecting the emitted light signal as the visible characteristic change of the sensor.

22. The method of claim 15, wherein:

the sensor comprises a compressible housing having a window portion and a spring configured to extend into the window portion upon compression of the housing; and

the determining from the image when the visible characteristic changes includes detecting the extension of the spring into the window portion as the visible characteristic change of the sensor.

23. The method of claim 15, wherein

the sensor comprises a compressible reservoir containing fluid and a transparent capillary extending from the reservoir such that the fluid flows into the capillary upon compression of the reservoir;

and

the determining from the image when the visible characteristic changes includes detecting the flow of the fluid into the capillary as the visible characteristic change of the sensor.

24. The method of claim 15, wherein:

the sensor is a plurality of sensors each of which includes a different color or pattern relative to the other sensors; and

the activating of a portion of the virtual input device comprises activating different portions or functions of the virtual input device in dependence on the different colors or patterns of the sensors.