Generating a conversation in a social network based on mixed media object context

• US 10,200,336 B2
• Filed: 09/11/2017
• Issued: 02/05/2019
• Est. Priority Date: 07/27/2011
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Bailloeul, Timothee, Behrendt, Dani Essindi
• Primary Examiner(s): Tran, Anhtai V
• Application Number:
  US15/701,295
• Publication Number:
  US 20180109484A1
• Time in Patent Office: 512 Days
• Field of Search: None
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04L 51/52 for supporting social networking services

Abstract

A system and method for generating a conversation in a social network based on visual search results. A mixed media reality (MMR) engine indexes source materials as MMR objects, receives images from a user device and identifies matching MMR objects. A content management engine generates metadata corresponding to the MMR objects. A social network application generates conversations corresponding to the MMR object. The conversation includes multiple discussion threads. If a conversation already exists, the social network application provides the user with access to the conversation.

Claims

1. A computer-implemented method comprising:

receiving, with one or more processors, an image from a user device;

performing, with the one or more processors, a visual search using the image to identify an object in the image, the object being identified from a database by performing feature extraction;

determining, with the one or more processors, whether a conversation corresponding to the object in the image exists in a social network; and

responsive to an absence of the conversation, generating, with the one or more processors, the conversation corresponding with the object in the image.

2. The computer-implemented method of claim 1, further comprising, responsive to determining that the conversation corresponding to the object in the image exists, providing a user with access to the conversation.

3. The computer-implemented method of claim 2, further comprising generating a user interface that provides a user with an option to perform at least one of:

submitting a new comment to the conversation, viewing all comments associated with the conversation, and posting a reply to an existing comment.

4. The computer-implemented method of claim 1, further comprising generating a user interface that includes at least one of:

a second image corresponding to the object in the image, a link associated with the object in the image, and a mechanism for enabling a user to input a comment.

5. The computer-implemented method of claim 1, further comprising determining metadata related to the object in the image, wherein the metadata includes at least one of:

a tag, a comment, a reply, a second image, and a location.

6. The computer-implemented method of claim 5, further comprising determining whether a cluster exists based on the metadata.

7. The computer-implemented method of claim 1, further comprising generating statistics for the object in the image that include at least one of:

a number of conversations associated with the object in the image, a number of comments associated with the object in the image, and a number of users that are part of the conversation associated with the object in the image.

8. A system comprising:

a processor; and

a memory, coupled with the processor, the memory storing instructions, which when executed by the processor cause the processor to;

receive an image from a user device;

perform a visual search using the image to identify an object in the image, the object being identified from a database by performing feature extraction;

determine whether a conversation corresponding to the object in the image exists in a social network; and

responsive to an absence of the conversation, generate the conversation corresponding with the object in the image.

9. The system of claim 8, wherein the instructions further cause the processor to, responsive to determining that the conversation corresponding to the object in the image exists, provide a user with access to the conversation.

10. The system of claim 9, wherein the instructions further cause the processor to generate a user interface that provides a user with an option to perform at least one of:

submitting a new comment to the conversation, viewing all comments associated with the conversation, and posting a reply to an existing comment.

11. The system of claim 8, wherein the instructions further cause the processor to generate a user interface that includes at least one of:

a second image corresponding to the object in the image, a link associated with the object in the image, and a mechanism for enabling a user to input a comment.

12. The system of claim 8, wherein the instructions further cause the processor to determine metadata related to the object in the image, wherein the metadata includes at least one of:

a tag, a comment, a reply, a second image, and a location.

13. The system of claim 12, wherein the instructions further cause the processor to determine whether a cluster exists based on the metadata.

14. The system of claim 8, wherein the instructions further cause the processor to generate statistics for the object in the image that include at least one of:

a number of conversations associated with the object in the image, a number of comments associated with the object in the image, and a number of users that are part of the conversation associated with the object in the image.

15. A computer program product comprising a non-transitory computer useable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

receive an image from a user device;

perform a visual search using the image to identify an object in the image, the object being identified from a database by performing feature extraction;

determine whether a conversation corresponding to the object in the image exists in a social network; and

responsive to an absence of the conversation, generate the conversation corresponding with the object in the image.

16. The computer program product of claim 15, wherein the computer readable program further causes the computer to, responsive to determining that the conversation corresponding to the object in the image exists, provide a user with access to the conversation.

17. The computer program product of claim 16, wherein the computer readable program further causes the computer to generate a user interface that provides a user with an option to perform at least one of:

submitting a new comment to the conversation, viewing all comments associated with the conversation, and posting a reply to an existing comment.

18. The computer program product of claim 15, wherein the computer readable program further causes the computer to generate a user interface that includes at least one of:

a second image corresponding to the object in the image, a link associated with the object in the image, and a mechanism for enabling a user to input a comment.

19. The computer program product of claim 15, wherein the computer readable program further causes the computer to determine metadata related to the object in the image, wherein the metadata includes at least one of:

a tag, a comment, a reply, a second image, and a location.

20. The computer program product of claim 19, wherein the computer readable program further causes the computer to determine whether a cluster exists based on the metadata.