Manipulating association of data with a physical object

• US 7,479,950 B2
• Filed: 04/14/2008
• Issued: 01/20/2009
• Est. Priority Date: 06/15/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Roseway, Asta J., Wong, Curtis Glenn, Drucker, Steven M., Dehlin, Joel P.
• Primary Examiner(s): OSORIO, RICARDO
• Application Number:
  US12/102,236
• Publication Number:
  US 20080231609A1
• Time in Patent Office: 281 Days
• Field of Search: 345/156, 345/173, 345/589
• US Class Current: 345/173
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/14 Display of multiple viewports

Abstract

Data elements stored in a computing system and associated with a physical object are reassociated with the same or another physical object. An identifying characteristic presented by the physical object, such as a reflective pattern applied to the object, is detected when the object is positioned adjacent to the interactive display surface. Images or other files associated with the identifying characteristic are accessed and displayed on the interactive display surface. A gesture by a user adjacent to the interactive display surface is detected to reassociate a selected representation. For example, the user can change where the selected element fits in a sequence of data elements, or reassociate the selected element with a second object placed on the interactive display surface. In a networked environment, the reassociated element can be stored on a server and subsequently accessed from a different interactive surface via the network using the second physical object.

Claims

1. A method for reassociating data elements associated with a physical object placed adjacent to an interactive display surface connected to a computing device, the method comprising:

(a) storing computer readable machine instructions on a computer readable media that when executed by a processor cause reading a characteristic presented by the physical object when the physical object is disposed adjacent to the interactive display surface to be performed;

(b) storing computer readable machine instructions on a computer readable media that when executed by a processor cause accessing the data elements associated with the characteristic from data storage to be performed;

(c) storing computer readable machine instructions on a computer readable media that when executed by a processor cause showing on the interactive display surface a representation depicting each of the data elements to be performed;

(d) storing computer readable machine instructions on a computer readable media that when executed by a processor cause detecting adjacent to the interactive display surface a user movement indicating a user command to reassociate a selected representation of a data element to be performed;

(e) storing computer readable machine instructions on a computer readable media that when executed by a processor cause reassociating the data element corresponding to the selected representation to be performed; and

(f) storing computer readable machine instructions on a computer readable media that when executed by a processor cause visually confirming reassociation of the data element by showing the selected representation being reassociated on the interactive display surface to be performed.

2. The method of claim 1, wherein the characteristic includes a light reflective identification disposed on a surface of the physical object.

3. The method of claim 1, wherein the representation of each of the data elements includes one of:

(a) a content of the data element;

(b) a portion of the content of the data element;

(c) a name representing the data element; and

(d) an icon representing the data element.

4. The method of claim 3, wherein a manner of presenting the representation is determined by a location where the physical object is placed on the interactive display surface.

5. The method of claim 1, wherein the user movement includes one of:

(a) a hand gesture;

(b) a movement of a pointing object presenting a pointing identifier; and

(c) a movement of the physical object.

6. The method of claim 1, wherein the computer readable machine instructions on a computer readable media that when executed by a processor cause reassociating the data element corresponding to the selected representation includes computer readable machine instructions on a computer readable media that when executed by a processor cause resequencing the data elements associated with the characteristic to be performed.

7. The method of claim 1, wherein computer readable machine instructions on a computer readable media that when executed by a processor cause showing the selected representation being reassociated on the interactive display surface includes computer readable machine instructions on a computer readable media that when executed by a processor cause presenting a reassociation animation between the selected representation and a reassociation point, said reassociation animation including one of:

(a) the reassociation point pulling the selected representation into the reassociation point;

(b) the selected representation vanishing into the reassociation point;

(c) the selected representation shrinking into the reassociation point; and

(d) the selected representation curving into the reassociation point.

8. The method of claim 7, further comprising computer readable machine instructions on a computer readable media that when executed by a processor cause identifying a type of user movement;

and determining the reassociation animation presented depending on the type of user movement that was identified to be performed.

9. The method of claim 1, further comprising computer readable machine instructions on a computer readable media that when executed by a processor cause performing an opening animation visually indicating the emergence of the representations from an entry point associated with the characteristic to be performed.

10. The method of claim 1;

further comprising;

(a) computer readable machine instructions on a computer readable media that when executed by a processor cause detecting when the characteristic is no longer adjacent to the interactive display surface to be performed; and

(b) computer readable machine instructions on a computer readable media that when executed by a processor cause disabling a capability for reassociating the data elements associated with the characteristic to be performed.

11. A method for reassociating data elements associated with a first physical object placed adjacent to an interactive display surface connected to a computing device, the method comprising the steps of:

(a) storing computer readable machine instructions on a computer readable media that when executed by a processor cause reading a first characteristic presented by the first physical object when the first physical object is disposed adjacent to the interactive display surface to be performed;

(b) storing computer readable machine instructions on a computer readable media that when executed by a processor cause accessing the data elements associated with the first characteristic from data storage to be performed;

(c) storing computer readable machine instructions on a computer readable media that when executed by a processor cause showing on the interactive display surface a representation depicting each of the data elements to be performed;

(d) storing computer readable machine instructions on a computer readable media that when executed by a processor cause reading a second characteristic presented by a second physical object when the physical object is disposed adjacent to the interactive display surface to be performed;

(e) storing computer readable machine instructions on a computer readable media that when executed by a processor cause detecting adjacent to the interactive display surface a user movement indicating a user command to reassociate a selected representation with the second characteristic to be performed; and

(f) storing computer readable machine instructions on a computer readable media that when executed by a processor cause reassociating the data elements depicted by each selected representation with the second characteristic presented by the second physical object to be performed.

12. The method of claim 11, wherein at least one of the first characteristic presented by the first physical object and the second characteristic presented by the second physical object includes a light reflective identification.

13. The method of claim 11, wherein the user movement includes one of:

(a) a hand gesture;

(b) a movement of a pointing object presenting a pointing identifier; and

(c) a movement of the physical object.

14. The method of claim 11, wherein the computer readable machine instructions on a computer readable media that when executed by a processor cause reassociating the data element with the second characteristic includes one of:

(a) computer readable machine instructions on a computer readable media that when executed by a processor cause copying the data from a first storage location associated with the first characteristic to a second storage location associated with the second characteristic to be performed; and

(b) computer readable machine instructions on a computer readable media that when executed by a processor cause moving the data from the first storage location associated with the first characteristic to the second storage location associated with the second characteristic to be performed.

15. The method of claim 11, wherein the second characteristic is associated with one of:

(a) a local data storage associated with the computing device that is associated with the interactive display surface; and

(b) a remote data storage on a server accessible over a network, such that the data elements associated with the second identifier are accessed via one of;

(i) the interactive display surface; and

(ii) a second interactive display surface that is in communication with the remote data storage on the server.

16. The method of claim 11, further comprising storing computer readable machine instructions on a computer readable media that when executed by a processor cause visually confirming reassociation of the data element with the second characteristic by showing the selected representation being reassociated with the second characteristic presented by the second physical object on the interactive display surface to be performed.

17. The method of claim 16, wherein the computer readable machine instructions on a computer readable media that when executed by a processor cause showing the selected representation being reassociated with a reassociation point associated with the second characteristic presented by the second physical object on the interactive display surface to be performed includes computer readable machine instructions on a computer readable media that when executed by a processor cause carrying out one of the steps of:

(a) the reassociation point pulling the selected representation into the second characteristic presented by the second physical object;

(b) the selected representation vanishing into the reassociation point;

(c) the selected representation shrinking into the reassociation point; and

(d) the selected representation curving into the reassociation point.

18. The method of claim 17, further comprising storing computer readable machine instructions on a computer readable media that when executed by a processor cause identifying a type of user movement;

and determining the reassociation animation presented depending on the type of user movement that was identified to be performed.

19. The method of claim 11, further comprising storing computer readable machine instructions on a computer readable media that when executed by a processor cause performing an opening animation visually indicating the emergence of the representations from an entry point associated with the first characteristic presented by the first physical object to be performed.

20. The method of claim 11, further comprising:

(a) storing computer readable machine instructions on a computer readable media that when executed by a processor cause detecting when at least one of the first characteristic presented by the first physical object and the second characteristic presented by the second physical object is no longer adjacent to the interactive display surface to be performed; and

(b) storing computer readable machine instructions on a computer readable media that when executed by a processor cause disabling a capability for reassociating the data elements in response thereto to be performed.