Enhanced accuracy of user presence status determination

• US 9,836,590 B2
• Filed: 06/22/2012
• Issued: 12/05/2017
• Est. Priority Date: 06/22/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Archambault, Anne Marie Renee, Berg, Jeffrey Scott, Zuo, Xiping, Agrawal, Abhishek
• Primary Examiner(s): Abraham, Samantha K
• Application Number:
  US13/531,042
• Publication Number:
  US 20130346084A1
• Time in Patent Office: 1,992 Days
• Field of Search: 356 403, 356 404, 356 21, 348140
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2221/2111 Location-sensitive, e.g. geographical location, GPS
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G10L 25/27 characterised by the analysis technique

Abstract

Technologies are described herein for enhancing a user presence status determination. Visual data may be received from a depth camera configured to be arranged within a three-dimensional space. A current user presence status of a user in the three-dimensional space may be determined based on the visual data. A previous user presence status of the user may be transformed to the current user presence status, responsive to determining the current user presence status of the user.

Claims

1. A method for enhancing a user presence status determination, the method comprising:

receiving user presence data for a user, the user presence data comprising one or more of login data, input device data, meeting information from a calendar, or information indicative of usage of a telephone associated with the user;

determining for the user, based at least in part on the user presence data, a first user presence status from a plurality of user presence statuses;

receiving visual data from a camera configured to be arranged within a three-dimensional space;

receiving audio data from a microphone;

determining for the user, based at least in part on at least one of the visual data or the audio data, a second user presence status from the plurality of user presence statuses, the second user presence status being different from the first user presence status; and

updating the first user presence status associated with the user to the second user presence status, the second user presence status being accessible by additional users.

2. The method of claim 1, wherein the visual data indicates a presence of a person in the three-dimensional space;

and wherein determining the second presence status includes determining the second presence status using the presence of the person as an input.

3. The method of claim 1, wherein the visual data indicates a position of a person relative to the three-dimensional space or relative to one or more objects in the three-dimensional space;

and wherein determining the visual data in the three-dimensional space uses the position of the person as an input.

4. The method of claim 1, wherein the visual data indicates a clothing color of a person in the three-dimensional space;

and further comprising distinguishing the person based on the clothing color of the person in relation to a clothing color of a second person.

5. The method of claim 1, wherein the visual data indicates a posture of a person in the three-dimensional space;

and wherein determining the visual data in the three-dimensional space uses the posture of the person as an input.

6. The method of claim 1, wherein the visual data comprises facial data identifying a person in the three-dimensional space;

and wherein determining the visual data in the three-dimensional space uses the facial data as an input.

7. The method of claim 1, wherein the audio data comprises directional data indicating a source direction of the audio data;

and wherein determining the audio data in the three-dimensional space uses the directional data as an input.

8. The method of claim 1, wherein the audio data comprises voice data identifying a person in the three-dimensional space;

and wherein determining the audio data in the three-dimensional space uses the voice data as an input.

9. The method of claim 1, further comprising controlling a communication client based on the second user presence status.

10. An optical disk, a magnetic storage device, or a solid state storage device having computer-executable instructions stored thereon which, when executed by a computer, cause the computer to:

receive user presence data for a user, the user presence data comprising one or more of login data, input device data, meeting information from a calendar, and information indicating that a telephone is in use;

determine, based at least in part on the user presence data, a first user presence status from a plurality of user presence statuses;

receive visual data from a sensor device configured to be arranged within a three-dimensional space;

receive audio data from a microphone configured to be arranged within the three-dimensional space; and

determine, based at least in part on at least one of the visual data and the audio data, a second user presence status different from the first user presence status, the second user presence status being used to update an availability of the user.

11. The optical disk, the magnetic storage device, or the solid state storage device of claim 10, having further computer-readable instructions stored thereon which, when executed by the computer, cause the computer to:

identify presences of a first person and a second person in the three-dimensional space based on the visual data and the audio data;

responsive to identifying the presences of the first person and the second person, determine an identity of the first person and an identity of the second person;

determine that the identity of the first person corresponds to a first user; and

determine that the identity of the second person corresponds to a second user.

12. The optical disk, the magnetic storage device, or the solid state storage device of claim 11, having further computer-executable instructions stored thereon which, when executed by the computer, cause the computer to:

responsive to determining the identity of the first person corresponds to the first user, determine a current user presence status of the first user in the three-dimensional space; and

responsive to determining the identity of the second person corresponds to the second user, determine a current user presence status of the second user in the three-dimensional space.

13. The optical disk, the magnetic storage device, or the solid state storage device of claim 12, wherein the current user presence status of the first user indicates that the first user is located in the three-dimensional space and the current user presence status of the second user indicates that the second user is also located in the three-dimensional space.

14. The optical disk, the magnetic storage device, or the solid state storage device of claim 11, wherein to identify the presences of the first person and the second person in the three-dimensional space, the optical disk, the magnetic storage device, or the solid state storage device having further computer-executable executable instructions stored thereon which, when executed by the computer, cause the computer to:

identify a posture of the first person;

identify a position of the first person relative to the three-dimensional space, relative to one or more objects in the three-dimensional space, or relative to the second person;

identify a posture of the second person; and

identify a position of the second person relative to the three-dimensional space, relative to the one or more objects in the three-dimensional space, or relative to the first person.

15. The optical disk, the magnetic storage device, or the solid state storage device of claim 11, wherein to identify the presences of the first person and the second person in the three-dimensional space, the optical disk, the magnetic storage device, or the solid state storage device having further computer-executable executable instructions stored thereon which, when executed by the computer, cause the computer to:

identify a voice of the first person;

identify a source direction of the voice of the first person;

identify a voice of the second person; and

identify a source direction of the voice of the second person.

16. The optical disk, the magnetic storage device, or the solid state storage device of claim 10, having further computer-executable instructions stored thereon which, when executed by the computer, cause the computer to:

control a communication client based on the second user presence status.

17. A user presence determination system, comprising:

a sensor device comprising a depth camera and a microphone array arranged in a three-dimensional space;

a processor;

a memory communicatively coupled to the processor; and

a program module which executes in the processor from the memory and which, when executed by the processor, causes the processor to

receive user presence data of a user, the user presence data comprising login data, input device data, meeting information from a calendar, and information indicating that a telephone associated with the user is in use,

determine for the user, based at least in part on the user presence data, a first user presence status from a plurality of user presence statuses,

receive visual data from the depth camera,

receive audio data from the microphone array,

determine for the user, based at least in part on the visual data and the audio data, a second user presence status different from the first user presence status, the second user presence status being used to update an availability of the user.

18. The user presence determination system of claim 17, wherein the program module, when executed by the processor, further causes the processor to

receive user presence data of a second user, the user presence data of the second user comprising login data of the second user, input device data of the second user, meeting information from a calendar of the second user, and information indicating that a telephone associated with the second user is in use,

identify a presence of a second person in the three-dimensional space based on the user presence data of the second user, the visual data, and the audio data, and

utilize the visual data and the audio data to generate enhanced user presence data of the second user, the enhanced user presence data of the second user used to update an availability of the second user.

19. The user presence determination system of claim 17, wherein the program module, when executed by the processor, further causes the processor to

control a communication client based on the second user presence status.