Multi-frame depth image information identification

• US 20130086674A1
• Filed: 09/30/2011
• Published: 04/04/2013
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: HORVITZ, ERIC, LIU, JAMES CHIA-MING, TAN, DESNEY S.
• Granted Patent: US 8,966,613 B2
• Time in Patent Office: Days
• US Class Current: 726/19
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 9/3231 Biological data, e.g. fingerprint, voice or retina network architectures or network communication protocols for supporting authentication of entities using biometrical features in a packet data network H04L63/0861

Abstract

Embodiments of the present invention relate to systems, methods, and computer storage media for identifying, authenticating, and authorizing a user to a device. A dynamic image, such as a video captured by a depth camera, is received. The dynamic image provides data from which geometric information of a portion of a user may be identified as well as motion information of a portion of the user may be identified. Consequently, a geometric attribute is identified from the geometric information. A motion attribute may also be identified from the motion information. The geometric attribute is compared to one or more geometric attributes associated with authorized users. Additionally, the motion attribute may be compared to one or more motion attributes associated with the authorized users. A determination may be made that the user is an authorized user. As such the user is authorized to utilize functions of the device.

Claims

1. A method in a computing environment utilizing a processor and memory for authenticating a user to a device, the method comprising:

receiving a dynamic image comprised of geometric information of a portion of the user and motion information of a portion of the user;

identifying, with the processor, a first attribute from the geometric information and a second attribute from the motion information;

comparing, with the processor, the first attribute from the geometric information and the second attribute from the motion information to one or more attributes associated with an authorized entity; and

authorizing the user to utilize one or more functions of the device.

2. The method of claim 1 further comprising instructing a camera to capture the dynamic image.

3. The method of claim 1, wherein the camera is functional to capture the dynamic image utilizing a human visible light spectrum, a human non-visible light spectrum, or a combination of a human visible light spectrum and a human non-visible light spectrum.

4. The method of claim 1, wherein the dynamic image is a video comprised of two or more frames.

5. The method of claim 1, wherein the dynamic image is comprised of depth information captured by a depth camera.

6. The method of claim 1, wherein the geometric information is comprised of three-dimensional information.

7. The method of claim 1, wherein the portion of the user comprises at least one selected from the following:

a hand of the user;

a head of the user;

a torso of the user;

an eye of the user;

a mouth of the user; and

an ear of the user.

8. The method of claim 1, wherein the first attribute represents a size of one or more features captured in the dynamic image.

9. The method of claim 1, wherein the motion information is inferred from a change in position of a point on the user from a first frame to a second frame of the dynamic image.

10. The method of claim 1, wherein the comparing of the first attribute and the second attribute is further comprised of determining the first attribute and the second attribute are individually comparable to attributes associated with an authorized entity within a predefined confidence level.

11. A handheld device for authenticating a user to the handheld device, the system comprising:

a processor;

a depth camera; and

computer storage media having computer-executable instructions embodied thereon, that when executed by the processor, cause the handheld device to perform a method, the method comprising;

(1) capturing, with the depth camera, a series of images of at least a portion of a head of the user;

(2) identifying a first attribute within the series of images;

(3) determining the user is an authorized user of the device based, at least in part, on the first attribute; and

(4) providing a first functionality of the device to the user in response to determining the user is an authorized user.

12. The handheld device of claim 11 further comprising a microphone.

13. The handheld device of claim 11, wherein the method further comprising:

capturing, with the microphone, a verbal input;

identifying a second attribute within the verbal input; and

determining the user is an authorized user of the device based, at least in part on the second input.

14. The handheld device of claim 11, wherein the series of image is comprised of a representation of a mouth of the user as the user mimics speaking one or more words.

15. The handheld device of claim 11, wherein the series of images is comprised of an ear of the user as the handheld device approaches the ear.

16. The handheld device of claim 11, wherein the series of images is comprised of a predefined sequence of facial expressions performed by the user.

17. The handheld device of claim 11, wherein the first attribute is a motion path of a point on the user as captured in the series of images.

18. The handheld device of claim 11, wherein the first attribute is a depth differential between a first point and a second point on the user as captured in the series of images

19. The handheld device of claim 11, wherein the first attribute is a change in a depth of a point on the user as captured in the series of images.

20. One or more computer storage media having computer-executable instructions embodied thereon, that when executed by a computing system having a processor and memory, cause the computing system to perform a method of authenticating a user of a device, the method comprising:

capturing an image sequence of a user with a camera coupled with a device, wherein each image of the image sequence is comprised of depth information;

identifying, with the processor, a first facial gesture in three dimensional space captured in the image sequence;

identifying, with the processor, a second facial gesture captured in three dimensional space in the image sequence;

determining the first facial gesture corresponds with a first authorizing gesture; and

determining, with the processor, the user is an authorized user of the device.