Pointing Device Using Proximity Sensing

• US 20100315336A1
• Filed: 06/16/2009
• Published: 12/16/2010
• Est. Priority Date: 06/16/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: BENKO, Hrvoje, ROSENFELD, Daniel, VILLAR, Nicolas, HELMES, John, IZADI, Shahram, HODGES, Stephen E., BUTLER, David Alexander
• Granted Patent: US 9,703,398 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence

Abstract

A pointing device using proximity sensing is described. In an embodiment, a pointing device comprises a movement sensor and a proximity sensor. The movement sensor generates a first data sequence relating to sensed movement of the pointing device relative to a surface. The proximity sensor generates a second data sequence relating to sensed movement relative to the pointing device of one or more objects in proximity to the pointing device. In embodiments, data from the movement sensor of the pointing device is read and the movement of the pointing device relative to the surface is determined. Data from the proximity sensor is also read, and a sequence of sensor images of one or more objects in proximity to the pointing device are generated. The sensor images are analyzed to determine the movement of the one or more objects relative to the pointing device.

Claims

1. A pointing device, comprising:

a movement sensor arranged to generate a first data sequence relating to sensed movement of the pointing device relative to a surface; and

a proximity sensor arranged to generate a second data sequence relating to sensed movement relative to the pointing device of one or more objects in proximity to the pointing device.

2. A pointing device according to claim 1, wherein the proximity sensor comprises at least one emitter and at least one detector.

3. A pointing device according to claim 1, wherein the second data sequence comprises a sequence of sensor images of the one or more objects.

4. A pointing device according to claim 1, wherein the one or more objects comprise at least one of:

one or more digits of a user;

a stylus;

a pen;

a brush;

a further pointing device; and

a mobile telephone.

5. A pointing device according to claim 1, wherein the one or more objects are on the surface.

6. A pointing device according to claim 1, wherein the proximity sensor comprises an illumination source arranged to illuminate the one or more objects, and a camera arranged to capture images of the one or more objects.

7. A pointing device according to claim 1, wherein the proximity sensor comprises at least one of:

an optical proximity sensor;

an ultrasonic proximity sensor;

an inductive proximity sensor;

an electrostatic proximity sensor;

a capacitive proximity sensor;

a thermal imaging sensor;

an acoustic sensor; and

a magnetic proximity sensor.

8. A pointing device according to claim 1, further comprising a projection device arranged to project a visual indication of an interaction zone in which the proximity sensor can sense the movement of the one or more objects.

9. A pointing device according to claim 1, further comprising a transmitter arranged to transmit a signal into a hand of a user in contact with the pointing device, and wherein the proximity sensor is arranged to detect one or more objects emitting the signal.

10. A pointing device according to claim 1, further comprising a communication interface arranged to transmit the first and second data sequence to a user terminal.

11. One or more tangible device-readable media with device-executable instructions for performing steps comprising:

reading data from a movement sensor of a pointing device and determining a movement of the pointing device relative to a surface;

reading data from a proximity sensor of the pointing device and generating a sequence of proximity sensor images of one or more objects in proximity to the pointing device; and

analyzing the proximity sensor images to determine a movement of the one or more objects relative to the pointing device.

12. One or more tangible device-readable media according to claim 11, further comprising device-executable instructions for performing steps comprising:

analyzing the movement of the one or more objects to identify a user gesture.

13. One or more tangible device-readable media according to claim 12, further comprising device-executable instructions for performing steps comprising:

controlling a software program in accordance with the identified gesture.

14. One or more tangible device-readable media according to claim 11, wherein the steps of reading data from a movement sensor and reading data from a proximity sensor are performed substantially concurrently.

15. One or more tangible device-readable media according to claim 11, further comprising device-executable instructions for performing steps comprising:

controlling the position of a cursor in a user interface in accordance with the movement of the pointing device relative to a surface and the movement of the one or more objects relative to the pointing device.

16. One or more tangible device-readable media according to claim 15, wherein the movement of the pointing device relative to a surface causes a larger displacement of the cursor than a corresponding movement of the one or more objects relative to the pointing device.

17. One or more tangible device-readable media according to claim 11, wherein generating a sequence of proximity sensor images of one or more objects in proximity to the pointing device comprises, for each proximity sensor image in the sequence:

subtracting a background image from the proximity sensor image to generate a processed version of the proximity sensor image;

locating the one or more objects in the processed version of the proximity sensor image; and

estimating a position of the one or more objects.

18. One or more tangible device-readable media according to claim 11, wherein the steps are performed on the pointing device.

19. One or more tangible device-readable media according to claim 11, wherein the steps are performed on a user terminal in communication with the pointing device.

20. A computer mouse, comprising:

a movement sensor arranged to generate a first data sequence relating to sensed movement of the computer mouse relative to a supporting surface; and

a proximity sensor arranged to generate a second data sequence relating to sensed movement relative to the computer mouse of one or more fingers of a user on the supporting surface in proximity to the computer mouse.