Generating a conversation in a social network based on visual search results

• US 9,058,331 B2
• Filed: 07/27/2011
• Issued: 06/16/2015
• Est. Priority Date: 07/27/2011
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Bailloeul, Timothee, Essindi, Dani
• Primary Examiner(s): TRAN, ANHTAI V
• Application Number:
  US13/192,458
• Publication Number:
  US 20130031125A1
• Time in Patent Office: 1,420 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04L 51/52 for supporting social networking services

Abstract

The present invention includes a system and method for generating a conversation in a social network based on visual search results. A mixed media reality (MMR) engine indexes source materials as MMR objects, receives images from a user device and identifies matching MMR objects. A content management engine generates metadata corresponding to the MMR objects. A social network application generates conversations corresponding to the MMR object. The conversation includes multiple discussion threads. If a conversation already exists, the social network application provides the user with access to the conversation.

Claims

1. A computer-implemented method, the method comprising:

receiving an image from a user device;

searching, with one or more processors, the database of mixed media objects to identify and retrieve a mixed media object in which the image occurs;

identifying, with the one or more processors, a cluster including the mixed media object in which the image occurs;

transmitting, to a social network application, a reference to the cluster;

determining, by the social network application, whether a conversation associated with the cluster exists in a social network; and

responsive to an absence of the conversation, generating the conversation associated with the cluster in the social network.

2. The method of claim 1, wherein the mixed media object corresponds to a source material and the conversation includes a plurality of discussions that relate to the source material.

3. The method of claim 1, further comprising responsive to determining that the conversation exists, providing a user associated with the image with access to the conversation.

4. The method of claim 3, further comprising generating a user interface that provides the user with an option to perform at least one of submitting a new comment to the conversation, viewing all comments associated with the conversation and posting a reply to an existing comment.

5. The method of claim 1, further comprising generating statistics for the mixed media object that include at least one of a number of conversations associated with the mixed media object, a number of comments associated with the mixed media object and a number of users that are part of the conversation associated with the mixed media object.

6. The method of claim 1, further comprising retrieving metadata associated with the mixed media object and determining whether the conversation associated with the cluster exists based on the metadata.

7. The method of claim 6, further comprising generating a user interface that includes at least one of an image of a source material, a link associated with the mixed media object and a mechanism for enabling a user to input a comment.

8. A system comprising:

one or more processors;

a visual search engine stored on a memory and executable by the one or more processors, the visual search engine for receiving an image from a user device, searching the database of mixed media objects to identify and retrieve a mixed media object in which the image occurs, and identifying a cluster including the mixed media object in which the image occurs; and

a social network application that is coupled to the visual search engine, the social network application for receiving, from the visual search engine, a reference to the cluster, determining whether a conversation associated with the cluster exists in a social network, and responsive to an absence of the conversation, generating the conversation associated with the cluster in the social network.

9. The system of claim 8, wherein the mixed media object corresponds to a source material and the conversation includes a plurality of discussions that relate to the source material.

10. The system of claim 8, wherein the social network application, responsive to determining that the conversation exists, provides a user associated with the image with access to the conversation.

11. The system of claim 8, wherein the social network application includes a user interface engine for generating a user interface that provides a user with an option to perform at least one of submitting a new comment to the conversation, viewing all comments associated with the conversation and posting a reply to an existing comment.

12. The system of claim 8, wherein the social network application includes a statistics manager for generating statistics for the mixed media object that include at least one of a number of conversations associated with the mixed media object, a number of comments associated with the mixed media object and a number of users that are part of the conversation associated with the mixed media object.

13. The system of claim 8, further comprising a content management engine coupled to the visual search engine and the social network application, the content management engine for transmitting metadata associated with the mixed media object to the social network application for determining whether the conversation associated with the cluster exists based on the metadata.

14. The system of claim 13, wherein the user interface engine generates a user interface that includes at least one of an image of a source material, a link associated with the mixed media object and a mechanism for enabling a user to input a comment.

15. The system of claim 8, wherein to search the database of mixed media objects the visual search engine is configured to extract features from the image.

16. A computer program product comprising a non-transitory computer useable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

receive an image from a user device;

search the database of mixed media objects to identify and retrieve a mixed media object in which the image occurs;

identify a cluster including the mixed media object in which the image occurs;

transmit a reference to the cluster to a social network application;

determine, by the social network application, whether a conversation associated with the cluster exists in a social network; and

responsive to an absence of the conversation, generate the conversation associated with the cluster in the social network.

17. The computer program product of claim 16, wherein the mixed media object corresponds to a source material and the conversation includes a plurality of discussions that relate to the source material.

18. The computer program product of claim 16, wherein responsive to determining that the conversation exists, the computer readable program causes the computer to provide a user associated with the image with access to the conversation.

19. The computer program product of claim 16, wherein the computer readable program further causes the computer to generate a user interface that provides a user with an option to perform at least one of submitting a new comment to the conversation, viewing all comments associated with the conversation and posting a reply to an existing comment.

20. The computer program product of claim 16, wherein the computer readable program further causes the computer to generate statistics for the mixed media object that include at least one of a number of conversations associated with the mixed media object, a number of comments associated with the mixed media object and a number of users that are part of the conversation associated with the mixed media object.