CAMERA-BASED MULTI-TOUCH MOUSE

• US 20100265178A1
• Filed: 04/17/2009
• Published: 10/21/2010
• Est. Priority Date: 04/17/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ofek, Eyal, Izadi, Shahram, Benko, Hrvoje, Helmes, John, Villar, Nicolas, Chen, Billy, Rosenfeld, Daniel Allen
• Granted Patent: US 8,446,367 B2
• Time in Patent Office: Days
• US Class Current: 345/163
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/042 by opto-electronic means

Abstract

Technologies for a camera-based multi-touch input device operable to provide conventional mouse movement data as well as three-dimensional multi-touch data. Such a device is based on an internal camera focused on a mirror or set of mirrors enabling the camera to image the inside of a working surface of the device. The working surface allows light to pass through. An internal light source illuminates the inside of the working surface and reflects off of any objects proximate to the outside of the device. This reflected light is received by the mirror and then directed to the camera. Imaging from the camera can be processed to extract touch points corresponding to the position of one or more objects outside the working surface as well as to detect gestures performed by the objects. Thus the device can provide conventional mouse functionality as well as three-dimensional multi-touch functionality.

Claims

1. A multi-touch input device comprising:

a base;

a working surface with an inside and an outside, the working surface disposed over the base forming a cavity between the base and the inside of the working surface;

a light source integral to the device;

a mirror disposed in the cavity; and

a camera operable to receive reflected light from the mirror, wherein the camera is focused on the mirror.

2. The device of claim 1 wherein the camera is operable to image all of the inside of the working surface that is unobscured to the mirror.

3. The device of claim 2 wherein internal light from the light source is received by the mirror and then reflected to the camera, the reflected light corresponding to an object positioned outside the working surface.

4. The device of claim 2 wherein the device allows ambient light to enter the device so as to be obscured by an object positioned outside the working surface resulting in a shadowed area corresponding to the object, the obscured ambient light reflecting off of the mirror to the camera.

5. The device of claim 1 wherein the light source provides infrared light.

6. The device of claim 5 further comprising an infrared pass filter disposed between the camera and incoming light to the camera.

7. The device of claim 1 further comprising a mouse mechanism operable to provide conventional mouse data corresponding to movement of the device over a surface.

8. The device of claim 1 wherein the camera is operable to image the inside of the working surface via the mirror wherein the image can be processed to extract a touch point corresponding to a position of an object outside the working surface.

9. The device of claim 1 wherein the camera is operable to image the inside of the working surface via the mirror wherein the image can be processed to detect a gesture performed by an object outside the working surface.

10. The device of claim 1 further comprising a light barrier operable to restrict the camera to imaging light reflected from the mirror.

11. The device of claim 1 wherein the working surface is a diffuse surface.

12. The device of claim 1 wherein the mirror is a combination of a first mirror and a distinct second mirror.

13. The device of claim 12 wherein the second mirror is disposed so as to view all of the inside of the working surface that is unobscured to the second mirror, the reflected light first reflected from the second mirror to the first mirror and then to the camera, wherein the camera is focused on the first mirror.

14. A multi-touch input device comprising:

a base;

a working surface with an inside and an outside, the working surface disposed over the base forming a cavity between the base and the inside of the working surface, wherein the working surface is a diffuse surface;

a light source of infrared light integral to the device wherein internal light from the light source is operable to be received by the mirror and then reflected to a camera, the reflected light corresponding to an object positioned outside the working surface;

a mirror operable to view all of the inside of the working surface that is unobscured to the mirror;

a camera operable to receive reflected light from the mirror, wherein the camera is focused on the mirror;

an infrared pass filter disposed between the camera and incoming light to the camera; and

a mouse mechanism operable to provide conventional mouse data corresponding to movement of the device over a surface.

15. The device of claim 14 wherein the camera is operable to image the inside of the working surface via the mirror wherein the image can be processed to extract a touch point corresponding to a position of an object outside the working surface.

16. The device of claim 14 wherein the camera is operable to image the inside of the working surface via the mirror wherein the image can be processed to detect a gesture performed by an object outside the working surface.

17. A multi-touch input device comprising:

a base;

a working surface with an inside and an outside, the working surface disposed over the base forming a cavity between the base and the inside of the working surface, wherein the working surface is a diffuse surface;

a light source of infrared light integral to the device wherein internal light from the light source is operable to be received by the mirror and then reflected to the camera, the reflected light corresponding to an object positioned outside the working surface;

a mirror disposed in the cavity wherein the mirror is a combination of a first mirror and a distinct second mirror;

a camera disposed in the cavity and operable to receive reflected light from the mirror, wherein the camera is focused on the mirror;

an infrared pass filter disposed between the camera and incoming light to the camera; and

a mouse mechanism operable to provide conventional mouse data corresponding to movement of the device over a surface.

18. The device of claim 17 wherein the second mirror is disposed so as to view all of the inside of the working surface that is unobscured to the second mirror, the reflected light reflected from the second mirror to the first mirror and then to the camera, wherein the camera is focused on the first mirror.

19. The device of claim 18 wherein the camera is operable to image the inside of the working surface via the first and second mirrors wherein the image can be processed to extract a touch point corresponding to a position of an object outside the working surface.

20. The device of claim 18 wherein the camera is operable to image the inside of the working surface via the first and second mirrors wherein the image can be processed to detect a gesture performed by an object outside the working surface.