Enhanced Accuracy of User Presence Status Determination

• US 20130346084A1
• Filed: 06/22/2012
• Published: 12/26/2013
• Est. Priority Date: 06/22/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Zuo, Xiping, Archambault, Anne Marie Rene, Berg, Jeffrey Scott, Agrawal, Abhishek
• Granted Patent: US 9,836,590 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2221/2111 Location-sensitive, e.g. geographical location, GPS
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G10L 25/27 characterised by the analysis technique

Abstract

Technologies are described herein for enhancing a user presence status determination. Visual data may be received from a depth camera configured to be arranged within a three-dimensional space. A current user presence status of a user in the three-dimensional space may be determined based on the visual data. A previous user presence status of the user may be transformed to the current user presence status, responsive to determining the current user presence status of the user.

Claims

1. A method for enhancing a user presence status determination, the method comprising:

receiving visual data from a depth camera configured to be arranged within a three-dimensional space;

determining a current user presence status of a user in the three-dimensional space based on the visual data; and

responsive to determining the current user presence status of the user, transforming a previous user presence status of the user to the current user presence status.

2. The method of claim 1, wherein the visual data indicates a presence of a person in the three-dimensional space;

and wherein determining the current user presence status of the user in the three-dimensional space comprises determining the current user presence status of the user in the three-dimensional space based on the presence of the person.

3. The method of claim 1, wherein the visual data indicates a position of a person relative to the three-dimensional space or relative to one or more objects in the three-dimensional space;

and wherein determining the current user presence status of the user in the three-dimensional space comprises determining the current user presence status of the user in the three-dimensional space based on the position of the person.

4. The method of claim 1, wherein the visual data indicates a clothing color of a person in the three-dimensional space;

and wherein determining the current user presence status of the user in the three-dimensional space comprises determining the current user presence status of the user in the three-dimensional space based on the clothing color of the person.

5. The method of claim 1, wherein the visual data indicates a posture of a person in the three-dimensional space;

and wherein determining the current user presence status of the user in the three-dimensional space comprises determining the current user presence status of the user in the three-dimensional space based on the posture of the person.

6. The method of claim 1, wherein the visual data comprises facial data identifying each of a person in the three-dimensional space;

and wherein determining the current user presence status of the user in the three-dimensional space comprises determining the current user presence status of the user in the three-dimensional space based on the facial data.

7. The method of claim 1, further comprising receiving audio data from a microphone configured to be arranged in the three-dimensional space;

and wherein determining the current user presence status of the user in the three-dimensional space comprises determining the current user presence status of the user in the three-dimensional space based on the visual data and the audio data.

8. The method of claim 7, wherein the audio data comprises directional data indicating a source direction of the audio data;

and wherein determining the current user presence status of the user in the three-dimensional space comprises determining the current user presence status of the user in the three-dimensional space based on directional data.

9. The method of claim 7, wherein the audio data comprises voice data identifying a person in the three-dimensional space;

and wherein determining the current user presence status of the user in the three-dimensional space comprises determining the current user presence status of the user in the three-dimensional space based on the voice data.

10. The method of claim 1, further comprising:

receiving user presence data comprising one or more of login data, input device data, calendar data, or telephone usage data; and

determining the previous user presence status based on the user presence data.

11. A computer-readable storage medium having computer-executable instructions stored thereon which, when executed by a computer, cause the computer to:

receive visual data from a depth camera configured to be arranged within a three-dimensional space;

receive audio data from a microphone configured to be arranged within the three-dimensional space;

identify a presence of a person in the three-dimensional space based on the received visual data and the received audio data;

determine a current user presence status of a user in the three-dimensional space based on the identified presence of the person; and

responsive to determining the current user presence status of the user, transform a previous user presence status of the user to the current user presence status.

12. The computer-readable storage medium of claim 11, wherein to identify the presence of the person in the three-dimensional space, the computer-readable storage medium having further computer-executable executable instructions stored thereon which, when executed by the computer, cause the computer to:

determine an identity of the person based on the received visual data and the received audio data; and

determine that the determined identity of the person corresponds to the user.

13. The computer-readable storage medium of claim 11, wherein to identify the presence of the person in the three-dimensional space, the computer-readable storage medium having further computer-executable executable instructions stored thereon which, when executed by the computer, cause the computer to:

identify presences of a first person and a second person in the three-dimensional space based on the received visual data and the received audio data;

responsive to identifying the presences of the first person and the second person, determine a first identity of the first person and a second identity of the second person;

determine that the determined first identity corresponds to a first user; and

determine that the determined second identity corresponds to a second user.

14. The computer-readable storage medium of claim 13, wherein to determine the current user presence status of the user in the three-dimensional space, the computer-readable storage medium having further computer-executable executable instructions stored thereon which, when executed by the computer, cause the computer to:

responsive to determining the determined first identity corresponds to the first user, determine a first current user presence status of the first user in the three-dimensional space; and

responsive to determining the determined second identity corresponds to the second user, determine a second current user presence status of the second user in the three-dimensional space.

15. The computer-readable storage medium of claim 14, wherein to transform the previous user presence status of the user to the current user presence status, the computer-readable storage medium having further computer-executable executable instructions stored thereon which, when executed by the computer, cause the computer to:

responsive to determining the first current user presence status of the first user, transform a first previous user presence status of the first user to the first current user presence status; and

responsive to determining the second current user presence status of the second user, transform a second previous user presence status of the first user to the second current user presence status.

16. The computer-readable storage medium of claim 15, wherein the first current user presence status indicates that the first current user is located in the three-dimensional space;

and wherein the second current user presence status indicates that the second current user is also located in the three-dimensional space.

17. The computer-readable storage medium of claim 13, wherein to identify the presences of the first person and the second person in the three-dimensional space, the computer-readable storage medium having further computer-executable instructions stored thereon which, when executed by the computer, cause the computer to:

identify a first posture of the first person;

identify a first position of the first person relative to the three-dimensional space, relative to one or more objects in the three-dimensional space, or relative to the second person;

identify a second posture of the second person; and

identify a second position of the second person relative to the three-dimensional space, relative to the one or more objects in the three-dimensional space, or relative to the first person.

18. The computer-readable storage medium of claim 13, wherein to identify the presences of the first person and the second person in the three-dimensional space, the computer-readable storage medium having further computer-executable instructions stored thereon which, when executed by the computer, cause the computer to:

identify a first voice of the first person;

identify a first source direction of the first voice;

identify a second voice of the first person; and

identify a second source direction of the second voice.

19. A user presence determination system, comprising:

a sensor device comprising a depth camera and a microphone array arranged in a three-dimensional space;

a processor;

a memory communicatively coupled to the processor; and

a program module which executes in the processor from the memory and which, when executed by the processor, causes the processor to

receive user presence data of a user, the user presence data comprising login data, input device data, calendar data, and telephone usage data associated with the user,

receive visual data from the depth camera,

receive audio data from the microphone,

identify a presence of a person in the three-dimensional space based on the user presence data, the received visual data, and the received audio data,

determine a current user presence status of the user in the three-dimensional space based on the identified presence of the person, and

responsive to determining the current user presence status of the user, transform a previous user presence status of the user to the current user presence status.

20. The user presence determination system of claim 19, wherein the program module, when executed by the processor, further causes the processor to

receive second user presence data of a second user, the second user presence data comprising second login data, second input device data, second calendar data, and second telephone usage data associated with the second user,

identify a second presence of a second person in the three-dimensional space based on the second user presence data, the received visual data, and the received audio data,

determine a second current user presence status of the second user in the three-dimensional space based on the identified second presence of the second person, and

responsive to determining the second user presence status of the second user, transform a second previous user presence status of the second user to the second current user presence status.