Recognition system for sharing information

• US 9,958,952 B2
• Filed: 11/07/2016
• Issued: 05/01/2018
• Est. Priority Date: 06/02/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Buban, Garret J.
• Primary Examiner(s): Du, Haixia
• Application Number:
  US15/345,162
• Publication Number:
  US 20170131781A1
• Time in Patent Office: 540 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04L 65/4061 Push-to services, e.g. push-to-talk or push-to-video
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A system and method for sharing information between users based on recognition of the users and their associated processing devices in a scene. Interactions can be physical, verbal or a combination of physical and verbal gestures. Movements of the user and other users are tracked and interactions detected between them. User processing devices are connected by detecting users within view of a capture device, the capture device detecting motion tracking data for the user, such as a skeletal model. Information sharing may be controlled by the processing devices directly, by an intermediary server, or by a combination of the processing device and an intermediary server.

Claims

1. A computer implemented method for sharing information between users, comprising:

receiving a first image captured by a first capture device, the first image including a first user, the first user having an associated first processing device;

identifying the first user and a first gesture performed by the first user from the first image;

receiving a second image captured by a second capture device, the second image including a second user, the second user having an associated second processing device;

identifying the second user and a second gesture performed by the second user from the second image;

determining whether the first and second gestures are predefined gestures for initiating information transfer from the first processing device to the second processing device;

transferring information from the first processing device to the second processing device based at least in part on determining that the first and second gestures are predefined gestures for initiating information transfer from the first processing device to the second processing device.

2. The computer implemented method of claim 1, further comprising determining whether the first user is associated with the first device from the identification of the first user.

3. The computer implemented method of claim 2, further comprising determining whether the second user is associated with the second device from the identification of the second user.

4. The computer implemented method of claim 1, wherein said determining whether the first and second gestures are predefined gestures for initiating information transfer from the first processing device to the second processing device comprises providing the first and second gestures to an information sharing application, the information sharing application adapted to enable information transfer between the first processing device and the second processing device based on detection of a predefined interaction of the first user with the second user.

5. The computer implemented method of claim 1, wherein the first and second users are identified by a third processing device separate from the first and second processing devices.

6. The computer implemented method of claim 1, wherein the first and second gestures are identified by a third processing device separate from the first and second processing devices.

7. The computer implemented method of claim 1, wherein the first user is identified by the first processing device.

8. The computer implemented method of claim 1, wherein the first gesture is identified by the first processing device.

9. The computer implemented method of claim 1, wherein the first capture device and first processing device are integrated together.

10. A processing device, comprising:

a computer memory for storing data;

a network interface for sending and receiving data; and

a processor configured to;

receive a first image captured by a first capture device, the first image including a first user, the first user having an associated first processing device;

identify the first user and a first gesture performed by the first user from the first image;

receive a second image captured by a second capture device, the second image including a second user, the second user having an associated second processing device;

identify the second user and a second gesture performed by the second user from the second image;

determine whether the first and second gestures are predefined gestures for initiating information transfer from the first processing device to the second processing device;

transfer information from the first processing device to the second processing device based at least in part on determining that the first and second gestures are predefined gestures for initiating information transfer from the first processing device to the second processing device.

11. The processing device of claim 10, wherein the processor configured to determine whether the first and second gestures are predefined gestures for initiating information transfer from the first processing device to the second processing device comprises the processor configured to provide the first and second gestures to an information sharing application, the information sharing application adapted to enable information transfer between the first processing device and the second processing device based on detection of a predefined interaction of the first user with the second user.

12. The processing device of claim 10, wherein at least one of the first user and first gesture are identified from skeletal models provided from depth data of the first image.

13. The processing device of claim 10, wherein at least one of the first user and first gesture are identified from RGB data of the first image.

14. The processing device of claim 10, wherein the first capture device and first processing device are integrated together.

15. The processing device of claim 14, wherein the first processing device communicates with the processor via a networked connection.

16. A computer readable storage device for providing instructions to a processor to perform a method of sharing information between users, the method comprising:

receiving a first image captured by a first capture device, the first image including a first user, the first user having an associated first processing device;

identifying the first user and a first gesture performed by the first user from the first image;

receiving a second image captured by a second capture device, the second image including a second user, the second user having an associated second processing device;

identifying the second user and a second gesture performed by the second user from the second image;

determining whether the first and second gestures are predefined gestures for initiating information transfer from the first processing device to the second processing device;

transferring information from the first processing device to the second processing device based at least in part on determining that the first and second gestures are predefined gestures for initiating information transfer from the first processing device to the second processing device.

17. The computer readable storage device of claim 16, wherein the first and second users are identified by a third processing device separate from the first and second processing devices.

18. The computer readable storage device of claim 16, wherein the first and second gestures are identified by a third processing device separate from the first and second processing devices.

19. The computer readable storage device of claim 16, wherein the first user is identified by the first processing device.

20. The computer readable storage device of claim 16, wherein the first gesture is identified by the first processing device.