Systems and methods for presenting content based on unstructured visual data

• US 10,298,837 B2
• Filed: 12/28/2016
• Issued: 05/21/2019
• Est. Priority Date: 12/28/2016
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Barnett, John Samuel, Bailey, William Samuel, Huang, Cheng, Li, Joshua, Li, Alexander Dauning
• Primary Examiner(s): Khan, Usman A
• Application Number:
  US15/393,014
• Publication Number:
  US 20180183995A1
• Time in Patent Office: 874 Days
• Field of Search: 34833302
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06V 10/70 using pattern recognition or machine learning optical pattern recognition or electronic computations therefor G06V10/88
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

Systems, methods, and non-transitory computer-readable media can receive a plurality of content items. Tag information is generated for each content item of the plurality of content items. The tag information comprises one or more tags, and at least one tag for each content item is generated based on a machine learning technique. Query information is received from a first user. One or more content items of the plurality of content items is identified based on the query information and the tag information.

Claims

1. A computer-implemented method comprising:

providing, by a computing system, a user with one or more re-creation recommendations, wherein

each re-creation recommendation comprises a content item that was previously published to a social networking system, and

the one or more re-creation recommendations comprise a first content item that is selected for inclusion in the one or more re-creation recommendations based on the user having previously interacted with the first content item on the social networking system;

receiving, by the computing system, a user selection of the first content item for re-creation;

presenting, by the computing system, location guidance to direct the user to a location associated with the previous first content item; and

presenting, by the computing system, camera orientation guidance for recreating the first content item.

2. The computer-implemented method of claim 1, wherein the presenting location guidance comprises presenting the location guidance in an augmented reality interface of a camera application.

3. The computer-implemented method of claim 1, wherein the presenting camera orientation guidance comprises presenting the camera orientation guidance in an augmented reality interface of a camera application.

4. The computer-implemented method of claim 3, wherein the presenting the camera orientation guidance comprises presenting a semi-transparent view of the first content item in the camera application.

5. The computer-implemented method of claim 1, wherein the one or more re-creation recommendations are determined based on social networking system activity by the first user.

6. The computer-implemented method of claim 5, wherein the one or more re-creation recommendations are determined based on previous content items liked by the user on the social networking system.

7. The computer-implemented method of claim 1, wherein the one or more re-creation recommendations are determined based on user location information associated with the user.

8. The computer-implemented method of claim 7, wherein

each re-creation recommendation of the one or more re-creation recommendations is associated with a particular location, and

each re-creation recommendation of the one or more re-creation recommendations is selected based on a number of content items associated with the particular location associated with the re-creation recommendation.

9. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform a method comprising;

providing a user with one or more re-creation recommendations, wherein

each re-creation recommendation comprises a content item that was previously published to a social networking system, and

the one or more re-creation recommendations comprise a first content item that is selected for inclusion in the one or more re-creation recommendations based on the user having previously interacted with the first content item on the social networking system;

receiving a user selection of the first content item for re-creation;

presenting location guidance to direct the user to a location associated with the first content item; and

presenting camera orientation guidance for recreating the first content item.

10. The system of claim 9, wherein the presenting location guidance comprises presenting the location guidance in an augmented reality interface of a camera application.

11. The system of claim 9, wherein the presenting camera orientation guidance comprises presenting the camera orientation guidance in an augmented reality interface of a camera application.

12. The system of claim 11, wherein the presenting the camera orientation guidance comprises presenting a semi-transparent view of the first content item in the camera application.

13. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

providing a user with one or more re-creation recommendations, wherein

each re-creation recommendation comprises a content item that was previously published to a social networking system, and

the one or more re-creation recommendations comprise a first content item that is selected for inclusion in the one or more re-creation recommendations based on the user having previously interacted with the first content item on the social networking system;

receiving a user selection of the first content item for re-creation;

presenting location guidance to direct the user to a location associated with the first content item; and

presenting camera orientation guidance for recreating the first content item.

14. The non-transitory computer-readable storage medium of claim 13, wherein the presenting location guidance comprises presenting the location guidance in an augmented reality interface of a camera application.

15. The non-transitory computer-readable storage medium of claim 13, wherein the presenting camera orientation guidance comprises presenting the camera orientation guidance in an augmented reality interface of a camera application.

16. The non-transitory computer-readable storage medium of claim 15, wherein the presenting the camera orientation guidance comprises presenting a semi-transparent view of the first content item in the camera application.