Disposing identifying codes on a user's hand to provide input to an interactive display application

• US 7,466,308 B2
• Filed: 06/28/2004
• Issued: 12/16/2008
• Est. Priority Date: 06/28/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Dehlin, Joel P.
• Primary Examiner(s): Hjerpe; Richard
• Assistant Examiner(s): Sheng; Tom V
• Application Number:
  US10/879,905
• Publication Number:
  US 20060007124A1
• Time in Patent Office: 1,632 Days
• Field of Search: 345/173, 345/175, 178/18.03, 178/18.09
• US Class Current: 345/175
• CPC Class Codes: G06F 2203/0331 Finger worn pointing device
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

Input for controlling an application is provided to a computer system having an interactive display surface with an optical vision system for sensing objects. An optical code selected to be detectable by the interactive display surface when positioned adjacent to the interactive display surface is associated with a control function. The optical code is provided on an article configured to be removably affixed to at least a portion of a user'"'"'s hand. When the portion of the user'"'"'s hand is moved to a position adjacent to the interactive display surface, the optical vision system detects the optical code and invokes the control function associated with the optical code. Thus, a user can provide input to the interactive display surface with movements of the user'"'"'s hand. A different optical code may be affixed to each digit of the user'"'"'s hand, enabling the user to selectively invoke a plurality of control functions.

Claims

1. A method for providing an input to an application executing on a computer system having an interactive display surface, comprising the steps of:

(a) providing a digital video camera mounted behind the display surface, the display surface being translucent, the digital video camera being responsive to infrared (IR) light and the digital video camera being responsive only to IR light reflected from an article in contact with or a short distance above the display surface;

(b) providing an infrared (IR) light source comprising a plurality of IR light emitting diodes (LEDs) mounted such that the IR light produced by the LEDs is directed toward the underside of the display surface;

(c) disposing a baffle between the IR light source and the digital video camera to prevent IR light that is directly emitted from the IR light source from entering the digital video camera;

(d) associating a set of orthogonal X and Y axes with the display surface;

(e) determining an identifying code selected to be detectable by the interactive display surface when the identifying code is positioned adjacent to the interactive display surface by a user engaging the interactive display surface;

(f) selecting an article, the article being configured to be removably affixed to at least a portion of a user'"'"'s hand so that the article need not be grasped by the user when engaging the interactive display surface; and

(g) providing the identifying code on the article, such that when the article is positioned adjacent to the interactive display surface by the user appropriately moving the at least the portion of the user'"'"'s hand, the interactive display surface detects the identifying code.

2. The method of claim 1, wherein the identifying code includes at least one of a bar code, a matrix code, a radial code, a gray scale code, an identifiable color, and a distinctive shape.

3. The method of claim 1, wherein the identifying code is associated with a response in the application, further comprising the step of invoking the response upon detecting the identifying code positioned adjacent to the interactive display surface.

4. The method of claim 1, wherein the article includes a digit cap configured to be worn on an end of a user'"'"'s digit.

5. The method of claim 1, wherein the article includes a layer configured with a first surface that is removably adhered to a user'"'"'s digit, and a second surface that is opposite the first surface and is provided with the identifying code.

6. The method of claim 1, wherein the article includes a hand covering configured to cover at least a portion of a palm of a user'"'"'s hand.

7. The method of claim 6, wherein the hand covering includes one of a glove, a mitten, a mitt, and a panel attachable to the user'"'"'s hand.

8. The method of claim 6, further comprising the steps of

(a) providing a plurality of identifying codes at a plurality of locations on the hand covering, each of the plurality of identifying codes being associated with a different response in the application;

and

(b) invoking a response associated with the identifying code provided at a location upon detecting the identifying code at the location positioned adjacent to the interactive display surface, by the user'"'"'s hand.

9. The method of claim 1, wherein the identifying code is provided on the article by at least one of the steps of forming, molding, printing, and depositing the identifying code on the article.

10. The method of claim 1, wherein the identifying code is provided on the article by forming the identifying code on an intermediate medium and attaching the intermediate medium to the article.

11. A method for providing an input to an application executing on a computer system coupled with an interactive display surface, the method comprising the steps of:

(a) providing a digital video camera mounted behind the display surface, the display surface being translucent, the digital video camera being responsive to infrared (IR) light and the digital video camera being responsive only to IR light reflected from an article in contact with or a short distance above the display surface;

(b) providing an infrared (IR) light source comprising a plurality of IR light emitting diodes (LEDs) mounted such that the IR light produced by the LEDs is directed toward the underside of the display surface;

(c) disposing a baffle between the IR light source and the digital video camera to prevent IR light that is directly emitted from the IR light source from entering the digital video camera;

(d) associating a set of orthogonal X and Y axes with the display surface;

(e) determining an optical code selected to be identifiable by the interactive display surface when the optical code is positioned adjacent to the interactive display surface;

(f) disposing the optical code on a portion of a user'"'"'s hand;

(g) configuring the application to invoke a particular response upon detection of the optical code adjacent to the interactive display surface;

(h) detecting the optical code when the optical code is positioned adjacent to the interactive display surface as a result of a movement of the user'"'"'s hand; and

(i) invoking the response upon detection of the optical code.

12. The method of claim 11, further comprising the steps of:

(a) determining a plurality of optical codes configured to be identifiable by the interactive display surface when each optical code is positioned adjacent to the interactive display surface;

(b) disposing the plurality of optical codes at a plurality of portions of a user'"'"'s hand;

(c) configuring the application to invoke a specific response upon detection of any of the plurality of optical codes adjacent to the interactive display surface, each optical code being associated with a different specific response;

(d) detecting any of the plurality of optical codes that is moved to a position adjacent to the interactive display surface as a result of a movement of the user'"'"'s hand; and

(e) invoking each specific response associated with any of the optical codes that were thus detected.

13. The method of claim 11, wherein the optical code includes at least one of a bar code, a matrix code, a radial code, a gray scale code, an identifiable color, and a distinctive shape.

14. The method of claim 11, wherein the optical code is selected to be detectable in response to infrared light reflected by the optical code.

15. The method of claim 11, wherein the optical code is disposed on the portion of the user'"'"'s hand by:

(a) selecting an article, the article being configured to be removably affixed to at least a portion of a user'"'"'s hand;

(b) providing the optical code on the article; and

(c) removably affixing the article to the portion of the user'"'"'s hand.

16. The method of claim 15, wherein the article includes a digit cap configured to be worn on an end of a user'"'"'s digit.

17. The method of claim 15, wherein the article includes a layer having a first surface configured to be removably adhered to a user'"'"'s digit, and having a second surface provided with the optical code that is detectable when positioned adjacent to the interactive display surface.

18. The method of claim 15, wherein the article includes a hand covering configured to cover at least a portion of a palm of a user'"'"'s hand.

19. The method of claim 18, wherein the hand covering includes one of a glove, a mitten, a mitt, and a panel attachable to the user'"'"'s hand.

20. The method of claim 18, further comprising the steps of

(a) providing a plurality of different optical codes at a plurality of locations on the hand covering, each of the plurality of different optical codes being associated with a corresponding different response in the application being executed;

(b) detecting any of the plurality of different optical codes being positioned adjacent to the interactive display surface; and

(c) carrying out each response associated with any of the plurality of different optical codes that was thus detected.

21. The method of claim 15, wherein the optical code is provided on the article by at least one of the steps of forming, molding, printing, and depositing the optical code on the article.

22. The method of claim 15, wherein the optical code is provided on the article by forming the optical code on an intermediate medium and attaching the intermediate medium to the article.

23. A system for providing an input to an application executing on a computer system coupled with an interactive display surface, the system comprising:

(a) an identifying code selected to be detectable by the interactive display surface when the identifying code is positioned adjacent to the interactive display surface;

(b) an attachment device adapted to removably affix the identifying code to a portion of a user'"'"'s hand

(c) a digital video camera mounted behind the display surface, the display surface being translucent, the digital video camera being responsive to infrared (IR) light and the digital video camera being responsive only to IR light reflected from an article in contact with or a short distance above the display surface;

(d) an infrared (IR) light source comprising a plurality of IR light emitting diodes (LEDs) mounted such that the IR light produced by the LEDs is directed toward the underside of the display surface;

(e) a baffle disposed between the IR light source and the digital video camera to prevent IR light that is directly emitted from the IR light source from entering the digital video camera; and

(f) a set of orthogonal X and Y axes associated with the display surface.

24. The system of claim 23, wherein the identifying code includes at least one of a bar code, a matrix code, a radial code, a gray scale code, an identifiable color, and a distinctive shape.

25. The system of claim 23, wherein the identifying code is associated with a response in the application, said response being invoked upon the IR light sensor detecting the IR light reflected by the identifying code positioned adjacent to the interactive display surface.

26. The system of claim 23, wherein the attachment device includes a deformable digit cap adapted to be worn on an end of a user'"'"'s digit.

27. The system of claim 23, wherein the attachment device includes a layer having a first surface adapted to be removably adhered to a user'"'"'s digit, and a second surface on which the identifying code is provided.

28. The system of claim 23, wherein the attachment device includes a hand covering adapted to cover at least a portion of a palm of a user'"'"'s hand.

29. The system of claim 28, wherein the hand covering includes one of a glove, a mitten, a mitt, and a panel adapted to be attach to a user'"'"'s hand.

30. The system of claim 28, wherein a plurality of different identifying codes are disposed at a plurality of locations on the hand covering, each of the plurality of different identifying codes being associated with a specific response in the application that is invoked upon detecting that a user'"'"'s hand has positioned the identifying code associated with the response adjacent to the interactive display surface.

31. The system of claim 23, wherein the identifying code is provided on the attachment device by at least one of forming, molding, printing, and depositing the identifying code on the attachment device.

32. The system of claim 23, wherein the identifying code is provided on the attachment device by forming the identifying code on an intermediate medium and attaching the intermediate medium to the attachment device.