CREATING VIRTUAL REPLICAS OF PHYSICAL OBJECTS

• US 20110145706A1
• Filed: 02/18/2011
• Published: 06/16/2011
• Est. Priority Date: 06/29/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wilson, Andrew David, Robbins, Daniel Chaim
• Granted Patent: US 7,978,185 B2
• Time in Patent Office: Days
• US Class Current: 715/702
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Abstract

The present invention extends to methods, systems, and computer program products for creating virtual replicas of physical objects. A computer system detects that a portion of a physical object has come into the physical vicinity of a portion of a multi-touch input display surface. The computer system accesses object identifying data corresponding to the object. The computer system uses the object identifying data to access image data for the object from a repository of stored image data. The computer system uses the at least the accessed image data to generate a virtual replica of the object. The computer system presents the virtual replica of the object at a location on the multi-touch input display surface where the portion of the object was detected.

Claims

1. A computer implemented method, which is implemented at a computer system having at least one processor in communication with a multi-touch input display surface, for virtually replicating a physical object at the multi-touch input display surface, the method comprising:

an act of the computing system detecting that a portion of a physical object has come within the physical vicinity of a portion of the multi-touch input display surface and prior to the physical object coming in contact with the multi-touch input display surface;

an act of accessing object identifying data corresponding to the physical object;

an act of using the object identifying data to access image data for the physical object from a repository of stored image data;

an act of using at least the accessed image data to generate a virtual replica of the physical object; and

an act of presenting the virtual replica of the physical object at a location on the multi-touch input display surface prior to the physical object coming in contact with the multi-touch input display surface.

2. The method of claim 1, wherein the physical vicinity is a predetermined distance.

3. The method of claim 2, wherein the predetermined distance is a predetermined number of inches.

4. The method of claim 2, wherein the predetermined distance is a predetermined number of feet.

5. The method of claim 1, wherein the physical vicinity is predetermined to be a physical vicinity within a same room.

6. The method of claim 1, wherein the physical vicinity is predetermined to be a vicinity in which the physical object hovers over the multi-touch input display surface.

7. The method as recited in claim 1, wherein the act of detecting that the portion of the physical object has come into the physical vicinity of the portion of the multi-touch input display surface prior to the physical object coming in contact with the multi-touch input display surface comprises at least one of detecting a wireless identifier for the physical object or scanning a code attached to the physical object when the physical object comes within the physical vicinity of a portion of the multi-touch input display surface.

8. The method as recited in claim 7, wherein the act of detecting that the portion of the physical object has come into the physical vicinity of the portion of the multi-touch input display surface comprises detecting a wireless identifier for the physical object.

9. The method as recited in claim 7, wherein the act of detecting that the portion of the physical object has come into the physical vicinity of the portion of the multi-touch input display comprises scanning the code attached to the physical object.

10. The method as recited in claim 1, wherein the act of accessing object identifying data corresponding to the physical object includes scanning a code attached to the physical object.

11. The method as recited in claim 1, wherein the act of accessing object identifying data corresponding to the physical object comprises an act of detecting a wireless identifier for the object.

12. The method of claim 1, wherein the method further includes displaying the virtual replica of the physical object at the location of the multi-touch input display surface proximate a location where the physical object is detected to be within the physical vicinity of.

13. The method of claim 1, wherein the method includes using a first sensor to detect the physical vicinity of the physical object and a second sensor is used to detect the object identifying data.

14. The method as recited in claim 1, wherein the act of using the object identifying data to access image data for the object from a repository of stored image data comprises:

an act of submitting a query to a database, the query including the object identifying data for the physical object; and

an act of receiving a response from the database, the response including a corresponding image data for creating a virtual replica of the physical object.

15. The method as recited in claim 1, further comprising:

subsequent to the act of presenting the virtual replica of the physical object at a location on the multi-touch input display surface, an act of detecting a contact of the physical object with the multi-touch input display surface.

16. The method as recited in claim 1, wherein presenting the virtual replica includes animating the virtual replica based on image behavior data associated with the physical object and by at least applying the image behaviors to the virtual replica.

17. The method as recited in claim 1, wherein the act of presenting the virtual replica of the physical object at a location on the multi-touch input display surface comprises an act of presenting multiple copies of the virtual replica on the multi-touch input display surface.

18. A computer storage device having stored computer-executable instructions that, when executed at a processor of a computing system that is in communication with a multi-touch input display surface of the computing system, cause the computing system to perform a method that includes:

using a first sensor to detect that a portion of a physical object has come within the physical vicinity of a portion of the multi-touch input display surface and prior to the physical object coming in contact with the multi-touch input display surface;

accessing object identifying data corresponding to the physical object with a second sensor;

using the object identifying data to access image data for the physical object from a repository of stored image data;

using at least the accessed image data to generate a virtual replica of the physical object; and

presenting the virtual replica of the physical object at a location on the multi-touch input display surface prior to the physical object coming in contact with the multi-touch input display surface.

19. The computer storage device of claim 18, wherein the method further includes combining the virtual replica with at least one other virtual replica to create a new virtual replica.

20. A computer system, comprising:

at least one processor;

a first sensor configured to detect a proximity of a physical object;

a second sensor configured to detect object identifying data associated with the physical object;

a multi-touch input display surface;

system memory; and

stored computer-executable instructions which, when executed by the at least one processor, implement a method for creating a virtual replica of the physical object at the multi-touch input display surface, the method comprising;

detecting that a portion of a physical object has come within the physical vicinity of a portion of the multi-touch input display surface with the first sensor and prior to the physical object coming in contact with the multi-touch input display surface;

accessing object identifying data corresponding to the physical object with the second sensor;

using the object identifying data to access image data for the object from a repository of stored image data;

using at least the accessed image data to generate a virtual replica of the physical object; and

presenting the virtual replica of the physical object at a location on the multi-touch input display surface prior to the physical object coming in contact with the multi-touch input display surface.