Associating application states with a physical object

• US 7,397,464 B1
• Filed: 04/30/2004
• Issued: 07/08/2008
• Est. Priority Date: 04/30/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wilson, Andrew D., Robbins, Daniel Chaim
• Primary Examiner(s): Patel; Nitin
• Application Number:
  US10/836,183
• Time in Patent Office: 1,530 Days
• Field of Search: 345156-184, 345/719, 705/701, 463/30, 463/31, 715/719, 235/380
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An application state of a computer program is stored and associated with a physical object and can be subsequently retrieved when the physical object is detected adjacent to an interactive display surface. An identifying characteristic presented by the physical object, such as a reflective pattern applied to the object, is detected when the physical object is positioned on the interactive display surface. The user or the system can initiate a save of the application state. For example, the state of an electronic game using the interactive display surface can be saved. Attributes representative of the state are stored and associated with the identifying characteristic of the physical object. When the physical object is again placed on the interactive display surface, the physical object is detected based on its identifying characteristic, and the attributes representative of the state can be selectively retrieved and used to recreate the state of the application.

Claims

1. A method for associating a state of a computer application with a physical object on an interactive display surface of a computer system, the method comprising the steps of:

(a) identifying the physical object based upon a characteristic of the physical object that is detectable when the physical object is disposed adjacent to the interactive display surface and by at least determining a position of the physical object relative to the interactive display surface and with the use of infrared light;

(b) receiving an indication to save the state of the computer application;

(c) storing attributes representative of the state in data storage not contained in the physical object; and

(d) associating the attributes representative of the state with the characteristic of the physical object, and thus, with the physical object.

2. The method of claim 1, wherein the characteristic includes a light reflective identification disposed on a surface of the physical object.

3. The method of claim 1, wherein the step of identifying the physical object includes the steps of:

(a) transmitting infrared light through the interactive display surface toward a face of the interactive display surface adjacent to which the physical object is disposed; and

(b) recognizing the light reflective identification disposed on the surface of the physical object by imaging infrared light reflected thereby.

4. The method of claim 1, further comprising:

associating the attributes representative of the state with the characteristic of the physical object and the position of the physical object.

5. The method of claim 4, wherein the position of the physical object includes at least one of a location of the physical object on the interactive display surface, and an orientation of the physical object relative to the interactive display surface.

6. The method of claim 4, further comprising the steps of:

(a) detecting a change in the position of the physical object relative to the interactive display surface; and

(b) associating the attributes representative of the state with the characteristic of the physical object and the change in position of the physical object.

7. The method of claim 6, wherein the change in the position of the physical object includes at least one of a rotation of the physical object, a translation of the physical object across the interactive display surface, and a movement of the physical object transverse to the interactive display surface.

8. The method of claim 1, further comprising the step of determining that the state is to be associated with the characteristic and with the physical object by determining whether the physical object is located within a region of the interactive display surface designated for state association with the physical object.

9. The method of claim 1, wherein the indication to store the state includes one of a command presented by a user, and a process initiated by the computer system.

10. The method of claim 9, wherein the command is presented by the user by carrying out one of the steps of:

(a) actuating a physical button on the physical object causing a save command identifier to be presented to the computing system;

(b) actuating a physical button on the computing system;

(c) selecting a virtual button presented on the interactive display surface;

(d) moving the physical object in a predefined save pattern;

(e) making a gesture associated with the save command adjacent to the interactive display surface, so that the gesture is detected thereby; and

(f) removing the physical object from a position adjacent to the interactive display surface.

11. The method of claim 1, wherein the data storage storing the attributes representative of the state is located in at least one of:

(a) a local storage device directly coupled with the computer system; and

(b) a remote storage device coupled with the computer system over a network.

12. The method of claim 1, further comprising the steps of:

(a) reading a second characteristic associated with a second physical object when the second physical object is disposed adjacent to the interactive display surface; and

(b) associating the attributes representative of the state with both the characteristic associated with the physical object and the second characteristic associated with the second physical object, and thus with both physical objects.

13. The method of claim 12, further comprising the steps of:

(a) determining a position of the physical object relative to the interactive display surface;

(b) determining a position of the second physical object relative to the interactive display surface; and

(c) associating the attributes representative of the state with the characteristic, the position of the first physical object, the second characteristic, and the position of the second physical object.

14. The method of claim 13, wherein the physical object is associated with a first user of a multi-user application, and the second physical object is associated with a second user of the multi-user application, the state comprising a common state of interaction with the multi-user application by the first user and by the second user.

15. The method of claim 13, wherein the state is associated with the characteristic and the position of the second physical object indicates a variation in the state associated with the characteristic.

16. The method of claim 15, further comprising detecting a change in the position of the second physical object relative to the interactive display surface such that the change in position of the second physical object indicates a variation in the state.

17. The method of claim 1, further comprising the steps of:

(a) identifying the physical object based upon the characteristic of the physical object, when the physical object is again disposed adjacent to the interactive display surface;

(b) receiving an indication to retrieve the state;

(c) retrieving the attributes representative of the state associated with the characteristic; and

(d) processing the attributes to recreate the state.

18. The method of claim 17, further comprising the steps of:

(a) detecting a position of the physical object when again disposed adjacent to the interactive display surface;

(b) presenting a plurality of states associated with both the physical object and each position of the physical object relative to the interactive display surface; and

(c) enabling a user to select one of the plurality of states.

19. The method of claim 18, wherein the plurality of states is presented by at least one of the steps of:

(a) presenting numbers assigned to the plurality of states;

(b) presenting names assigned to the plurality of states;

(c) presenting icons assigned to the plurality of states; and

(d) further comprising the step of presenting a view of the selected state when a selection is made by the user.

20. The method of claim 1, wherein the physical object has a plurality of different characteristics associated with it, each different characteristic being associated with a different face of the physical object such that any of the plurality of characteristics is selectively presented to interactive display surface by disposing the face presenting a chosen characteristic adjacent to the interactive display surface, enabling each face of the physical object to associated with a different state of the computer application.

21. A memory medium having machine executable instructions stored for carrying out the steps of claim 1.

22. A method for using a physical object to retrieve a state of an application running on a computer system that is coupled to an interactive display surface, the method comprising the steps of:

(a) reading a characteristic presented by the physical object upon detecting the physical object is disposed adjacent to the interactive display surface and by at least determining a position of the physical object relative to the interactive display surface with the use of infrared light, said characteristic and thus, said physical object being associated with attributes representative of a state of the application, said attributes having previously been stored by the computer system;

(b) receiving an indication to retrieve the state of the application that was previously stored;

(c) retrieving the attributes representative of the state associated with the characteristic and with the physical object from a storage device not contained in the physical object; and

(d) processing the attributes to recreate the state of the application.

23. The method of claim 22, wherein the characteristic includes an infrared-reflective marking disposed on a surface of the physical object.

24. The method of claim 23, wherein step of reading the characteristic includes the steps of:

(a) transmitting infrared light through the interactive display surface toward a face of the interactive display surface adjacent to which the physical object is disposed; and

(b) recognizing the characteristic presented by the physical object by detecting infrared light reflected by the characteristic presented by the physical object.

25. The method of claim 22, further comprising the steps of:

(a) reading the position of the characteristic relative to the interactive display surface when the physical object is disposed adjacent to the interactive display surface;

(b) presenting a plurality of states, each state being associated with both the characteristic and one of a plurality of positions of the characteristic on the interactive display surface;

(c) determining a selected state from among the plurality of states, based upon the position in which the characteristic was read;

(d) receiving an indication to retrieve the selected state;

(e) retrieving attributes defining the selected state associated with the characteristic and the position of the characteristic; and

(f) recreating the state based upon the attributes that were retrieved.

26. The method of claim 25, wherein the plurality of states is presented by at least one of the steps of:

(a) presenting numbers assigned to the plurality of states;

(b) presenting names assigned to the plurality of states;

(c) presenting icons assigned to the plurality of states; and

(d) enabling a user to select the selected state by choosing one of the numbers, the names, and the icons, further comprising the step of presenting a view of the selected state once the selected state is chosen by the user.

27. The method of claim 25, wherein the position of the characteristic includes at least one of a location of the physical object and an orientation of the physical object.

28. The method of claim 27, further comprising the steps of:

(a) detecting a change in the position of the physical object relative to the interactive display surface; and

(b) associating the attributes representative of the state with the characteristic of the physical object and the change in position of the physical object.

29. The method of claim 28, wherein the change in the position of the physical object includes at least one of a rotation of the physical object, a translation of the physical object across the interactive display surface, and a movement of the physical object transverse to the interactive display surface.

30. The method of claim 22, further comprising the step of determining that the physical object is associated with the attributes defined the state by determining whether the physical object is located within a region of the interactive display surface designated for state association with the physical object.

31. The method of claim 22, wherein the indication to retrieve the state includes one of a command presented by a user and a process initiated by the computer system.

32. The method of claim 31, wherein the command is presented by the user by carrying one of the steps of:

(a) actuating a physical button on the physical object, causing a save command identifier to be presented to and detected using the interactive display moving the physical object in a predefined retrieve pattern; and

making a gesture detected using the interactive display surface that is associated with a retrieve command. surface;

(b) actuating a physical button on the computing system;

(c) selecting a virtual button presented on the interactive display surface;

(d) moving the physical object in a predefined retrieve pattern; and

(e) making a gesture detected using the interactive display surface that is associated with a retrieve command.

33. The method of claim 22, wherein the data storage storing the attributes representative of the state are located in at least one of:

(a) a local storage device directly coupled with the computer system; and

(b) a remote storage device accessible by the computer system.

34. The method of claim 22, further comprising the steps of:

(a) reading a second characteristic presented by a second physical object when the second physical object is disposed adjacent to the interactive display surface, said second characteristic and said second physical object having been previously associated with the attributes representative of the state; and

(b) retrieving the attributes representative of the state that are associated with a combination of the characteristic and the second characteristic.

35. The method of claim 34, further comprising:

(a) determining a position of the characteristic relative to the interactive display surface;

(b) determining a position of the second characteristic relative to the interactive display surface; and

(c) retrieving the attributes representative of the state based upon the characteristic, the position of the characteristic, the second characteristic, and the position of the second characteristic.

36. The method of claim 34, wherein the physical object is associated with a first user of a multi-user application, and the second physical object is associated with a second user of the multi-user application, the state comprising a common state of interaction with the multi-user application by the first user and by the second user.

37. The method of claim 35, wherein the state is associated with the characteristic and the position of the second physical object indicates a variation in the state associated with the characteristic.

38. The method of claim 37, further comprising detecting a change in the position of the second physical object relative to the interactive display surface such that the change in position of the second physical object indicates a variation in the state.

39. A memory medium having machine instructions for carrying out the steps of claim 22.

40. A method for associating a state of a computer application with a physical object on an interactive display surface of a computer system, the method comprising the steps of:

identifying the physical object based upon a characteristic of the physical object that is detectable when the physical object is disposed adjacent to the interactive display surface;

receiving an indication to save the state of the computer application;

storing attributes representative of the state in data storage not contained in the physical object;

associating the attributes representative of the state with the characteristic of the physical object, and thus, with the physical object;

reading a second characteristic associated with a second physical object when the second physical object is disposed adjacent to the interactive display surface; and

associating the attributes representative of the state with both the characteristic associated with the physical object and the second characteristic associated with the second physical object, and thus with both physical objects.