Pointing device and method

• US 8,149,210 B2
• Filed: 12/31/2007
• Issued: 04/03/2012
• Est. Priority Date: 12/31/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft International Holdings BV (Microsoft Corporation)
• Inventors: Klier, Zvi, Katz, Sagi, Marder, Mattias, Yahav, Giora
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Bolotin, Dmitriy
• Application Number:
  US12/003,705
• Publication Number:
  US 20090167679A1
• Time in Patent Office: 1,555 Days
• Field of Search: 345/156, 345/157, 345/158, 463 2- 6, 463/31, 463/36, 463/37
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A system and method for identifying a pointing organ or a pointing device in a field of imaging of a 3-D imaging system and for calculating a line of pointing relative to this organ or device are disclosed. The method and system may be used to enable a user to communicate with computer programs, such as computer games, 3-D design programs and the like. The method and system may further employ a trigger-like mechanism to identify a movement of a user that may be interpreted as trigger activation.

Claims

1. A system comprising:

a 3-D imaging system that generates a 3D depth image of a user in the field-of-imaging (FOI) of said imaging system, the 3-D imaging system uses Time of Flight (TOF) 3-D imaging, the 3D system identifies at least a first point and a second point based on the 3D depth image, the first point is an eye, the 3D system generates continuous data of the spatial position of the first point and the second point based on the 3D image; and

a computation system that calculates a pointing line extending from said first point through said second point towards a screen based on the continuous data of the spatial positions, the computation system calculates an imaginary point on said screen at which said pointing line hits said screen.

2. The system of claim 1, wherein said TOF imaging uses at least one of 3-D imaging based on intensity of collected light and 3-D imaging based on phase shift to calculate depth of points in the FOI.

3. The system of claim 1, wherein said computation system:

determines whether the imaginary point coincides with a graphical image on said screen.

4. The system of claim 1 wherein said computation system presents a cursor on said screen at the imaginary point.

5. A method for allowing a user to intuitively point at a screen, comprising:

acquiring a 3D image of the user by using 3-D imaging camera that uses time-of-flight (TOF);

identifying a pointing object in a field of imaging of the 3-D imaging camera;

identifying a first point and a second point on said pointing object, said first point is located substantially close to the rear end of said pointing object and said second point is located substantially close to the front end of said pointing object;

identifying a third point on the pointing object, the third point is associated with a trigger mechanism;

determining 3D positions of said first point, said second point, and said third point based on the 3D depth image;

calculating a pointing line based on said 3D positions, said line extends from said first point, through said second point towards said screen, the calculating includes using the third point to improve the accuracy of the pointing line;

identifying a hit point of said pointing line on said screen; and

providing data of the location of said hit point on said screen.

6. The method of claim 5, further comprising identifying activation of the trigger mechanism.

7. The method of claim 5, further comprising:

presenting a graphical image on said screen; and

determining that said hit point coincides with the graphical image.

8. The method of claim 7 further comprising presenting a cursor on said screen at the hit point.

9. The method of claim 5 wherein said pointing object further comprises a reflective area adapted to be disclosed to said imaging camera when said trigger mechanism is activated.

10. The method of claim 5 wherein said pointing object further comprises a light source adapted to be disclosed to said imaging camera when said trigger mechanism is activated.

11. The method of claim 5, wherein said pointing device is shaped substantially as a pistol.

12. The method of claim 5, wherein the third point is not on the pointing line.