SYSTEMS AND METHODS FOR PROVIDING AUGMENTED REALITY OVERLAYS

• US 20180190032A1
• Filed: 12/20/2017
• Published: 07/05/2018
• Est. Priority Date: 12/30/2016
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Granted Patent: US 10,229,312 B2
• Time in Patent Office: Days
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

Systems, methods, and non-transitory computer-readable media can identify one or more objects depicted in a camera view of a camera application displayed on a display of a user device. An augmented reality overlay is determined based on the one or more objects identified in the camera view. The camera view is modified based on the augmented reality overlay.

Claims

1. A computer-implemented method comprising:

identifying, by a computing system, one or more objects depicted in a camera view of a camera application displayed on a display of a user device;

determining, by the computing system, an augmented reality overlay based on the one or more objects identified in the camera view; and

modifying, by the computing system, the camera view based on the augmented reality overlay.

2. The computer-implemented method of claim 1, wherein the one or more objects depicted in the camera view are identified based on machine learning techniques.

3. The computer-implemented method of claim 2, further comprising receiving user location information associated with the user device, wherein

the one or more objects depicted in the camera view are identified based on the user location information.

4. The computer-implemented method of claim 3, further comprising downloading to the user device one or more machine learning models associated with the user location information, wherein

the one or more objects depicted in the camera view are identified based on the one or more machine learning models.

5. The computer-implemented method of claim 1, wherein the augmented reality overlay comprises context information associated with an object of the one or more objects depicted in the camera view.

6. The computer-implemented method of claim 5, wherein the context information comprises social networking system information associated with the object.

7. The computer-implemented method of claim 6, wherein the social networking system information comprises one or more content items associated with the object posted by users of a social networking system.

8. The computer-implemented method of claim 1, wherein the augmented reality overlay comprises an interactive augmented reality object that appears to interact with an object of the one or more objects depicted in the camera view.

9. The computer-implemented method of claim 8, wherein the interactive augmented reality object is selected based on an association with the object.

10. The computer-implemented method of claim 1, wherein the determining the augmented reality overlay comprises

presenting a plurality of augmented reality overlays to a user, and

receiving a selection of an augmented reality overlay from the plurality of augmented reality overlays.

11. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform a method comprising;

identifying one or more objects depicted in a camera view of a camera application displayed on a display of a user device;

determining an augmented reality overlay based on the one or more objects identified in the camera view; and

modifying the camera view based on the augmented reality overlay.

12. The system of claim 11, wherein the one or more objects depicted in the camera view are identified based on machine learning techniques.

13. The system of claim 12, wherein

the method further comprises receiving user location information associated with the user device, and

the one or more objects depicted in the camera view are identified based on the user location information.

14. The system of claim 13, wherein

the method further comprises downloading to the user device one or more machine learning models associated with the user location information, and

the one or more objects depicted in the camera view are identified based on the one or more machine learning models.

15. The system of claim 11, wherein the augmented reality overlay comprises context information associated with an object of the one or more objects depicted in the camera view.

16. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

identifying one or more objects depicted in a camera view of a camera application displayed on a display of a user device;

determining an augmented reality overlay based on the one or more objects identified in the camera view; and

modifying the camera view based on the augmented reality overlay.

17. The non-transitory computer-readable storage medium of claim 16, wherein the one or more objects depicted in the camera view are identified based on machine learning techniques.

18. The non-transitory computer-readable storage medium of claim 17, wherein

the method further comprises receiving user location information associated with the user device, and

the one or more objects depicted in the camera view are identified based on the user location information.

19. The non-transitory computer-readable storage medium of claim 18, wherein

the method further comprises downloading to the user device one or more machine learning models associated with the user location information, and

the one or more objects depicted in the camera view are identified based on the one or more machine learning models.

20. The non-transitory computer-readable storage medium of claim 16, wherein the augmented reality overlay comprises context information associated with an object of the one or more objects depicted in the camera view.