Facial patterns for optical barcodes

• US 10,699,174 B1
• Filed: 02/22/2019
• Issued: 06/30/2020
• Est. Priority Date: 03/18/2016
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Spiegel, Evan, Ouimet, Kirk
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US16/283,515
• Time in Patent Office: 494 Days
• CPC Class Codes: G06K 19/06037 multi-dimensional coding
• CPC Class Codes: G06K 19/06103 the marking being embedded in a human recognizable image, e.g. a company logo with an embedded two-dimensional code
• CPC Class Codes: G06T 7/33 using feature-based methods

Abstract

Systems and methods for using facial patterns for information access via optical barcodes are provided. In example embodiments, a computer accesses an image. The computer determines, using facial recognition, that the accessed image includes a face. The computer determines, using the face, an orientation of the image. The computer decodes, based on the determined orientation of the image, data encoded within the geometric shape. The computer may then access a resource based on the decoded data. In some aspects, a graphical output may be presented on a display device indicating the accessed resource.

Claims

1. A method comprising:

receiving, by one or more processors, an image that includes a face;

determining, by the one or more processors, a first line passing through two features of the face;

determining, by the one or more processors, a second line perpendicular to the first line;

determining, by the one or more processors, an orientation of the image based on the second line;

decoding, by the one or more processors, data encoded within the image based on the determined orientation; and

generating for display, on an electronic display, a graphical output based on the decoded data.

2. The method of claim 1, further comprising:

detecting eyes on the face as the two features; and

accessing a resource based on the decoded data.

3. The method of claim 1, further comprising detecting a geometric shape within the image, wherein the face is detected in response to the detection of the geometric shape.

4. The method of claim 3, further comprising analyzing image data within the geometric shape to determine that the image includes the face.

5. The method of claim 3, wherein the geometric shape comprises a rectangle, and wherein determining the orientation of the image comprises:

determining an orientation of the face;

setting an orientation of the geometric shape based on the orientation of the face and based on a direction of at least one side of the rectangle; and

determining the orientation of the image based on the orientation of the geometric shape.

6. The method of claim 5, further comprising:

determining that an orientation of a side of the rectangle and the second line are parallel within a predetermined angle of each other; and

determining the orientation of the geometric shape based on the orientation of the side.

7. The method of claim 6, wherein the predetermined angle is 45 degrees.

8. The method of claim 1, wherein the image is received from an imaging sensor or from a network.

9. The method of claim 1, wherein the face comprises an avatar or a drawing of a face.

10. The method of claim 1, wherein the face comprises a photograph of a human face.

11. A non-transitory machine-readable medium comprising instructions which, when executed by one or more processors of a computing device, cause the computing device to perform operations comprising:

receiving an image that includes a face;

determining a first line passing through two features of the face;

determining a second line perpendicular to the first line;

determining an orientation of the image based on the second line;

decoding data encoded within the image based on the determined orientation; and

generating for display a graphical output based on the decoded data.

12. The non-transitory machine-readable medium of claim 11, the operations further comprising:

detecting a geometric shape within the image; and

in response to detection of the geometric shape, analyzing image data within the geometric shape to determine that the image includes the face.

13. The non-transitory machine-readable medium of claim 12, wherein the geometric shape comprises a rectangle, and wherein determining the orientation of the image comprises:

determining an orientation of the face;

setting an orientation of the geometric shape based on the orientation of the face and based on a direction of at least one side of the rectangle; and

determining the orientation of the image based on the orientation of the geometric shape.

14. The non-transitory machine-readable medium of claim 13, the operations further comprising:

determining that an orientation of a side of the rectangle and the second line are parallel within a predetermined angle of each other; and

determining the orientation of the geometric shape based on the orientation of the side.

15. The non-transitory machine-readable medium of claim 11, the operations further comprising:

detecting eyes on the face as the two features; and

accessing a resource based on the decoded data.

16. A system comprising:

one or more hardware processors; and

a memory comprising instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising;

receiving an image that includes a face;

determining a first line passing through two features of the face;

determining a second line perpendicular to the first line;

determining an orientation of the image based on the second line;

decoding data encoded within the image based on the determined orientation; and

generating for display a graphical output based on the decoded data.

17. The system of claim 16, wherein the operations further comprise:

detecting eyes on the face as the two features; and

accessing a resource based on the decoded data.

18. The system of claim 16, wherein the operations further comprise detecting a geometric shape within the image, wherein the detection of the face is in response to the detection of the geometric shape.

19. The system of claim 18, wherein the operations further comprise analyzing image data within the geometric shape to determine that the image includes the face.

20. The system of claim 18, wherein the geometric shape comprises a rectangle, and wherein determining the orientation of the image comprises:

determining an orientation of the face;

setting an orientation of the geometric shape based on the orientation of the face and based on a direction of at least one side of the rectangle; and

determining the orientation of the image based on the orientation of the geometric shape.