Document-based networking with mixed media reality

• US 8,156,115 B1
• Filed: 03/31/2008
• Issued: 04/10/2012
• Est. Priority Date: 07/11/2007
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Erol, Berna, Hull, Jonathan J., Kishi, Hidenobu, Ke, Qifa, Moraleda, Jorge
• Primary Examiner(s): Pham, Hung Q
• Application Number:
  US12/060,194
• Time in Patent Office: 1,471 Days
• Field of Search: 707/608
• US Class Current: 707/728
• CPC Class Codes: G06Q 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition

Abstract

A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The present invention provides a system, method, and computer program product for modifying tie strength between members of an existing network using captured digital images of documents. Documents associated with the captured images are recognized and other members associated with the document are determined. Using this information, ties between members or the network are modified.

Claims

1. A method executable on at least one processor for modifying tie strength between members of an existing network using a digital image of at least a portion of a document, the method comprising:

receiving the digital image of at least a portion of the document associated with a first member in the existing network;

recognizing the document associated with the first member based on the received digital image;

recognizing an x-y location of the received digital image corresponding to the at least portion of the document;

determining a second member associated with the document based at least in part on the recognized x-y location; and

modifying with the at least one processor, at least one tie between the members of the existing network with respect to the first member and the second member, wherein modifying comprises creating a tie between the first member and the second member, wherein the first member and the second member previously were not tied within the existing network, wherein modifying parameterizes member information, and wherein the created tie is parameterized by a score based on a context of the received digital image of the at least portion of the document.

2. The method of claim 1, wherein modifying the at least one tie between the members of the existing network with respect to the first member and the second member comprises strengthening the tie between the first member and the second member.

3. The method of claim 1, further comprising providing an interestingness score for the document by the second member.

4. The method of claim 1, wherein recognizing the document further comprises an indexing operation that allows identification of a corresponding electronic representation of the document and associated second media types.

5. The method of claim 1, wherein recognizing the document is accomplished using an index of stored documents corresponding to digital images supplied by the members of the existing network.

6. The method of claim 5, wherein determining the second member associated with the document further comprises querying the index for a subset of the members of the existing network who have supplied a digital image of a document similar to the document associated with the first member.

7. The method of claim 6, wherein querying the index further comprises pattern matching and looking up member information for the subset of members.

8. The method of claim 7, wherein the pattern matching further comprises a pairwise comparison between a pair comprising the first member and at least one member of the subset, using a location of the first member and a location of the at least one member of the subset to produce a distance score for the pair, wherein the at least one tie is parameterized by the distance score for the pair.

9. The method of claim 7, wherein the pattern matching further comprises a pairwise comparison between a pair comprising the first member and at least one member of the subset, using a timestamp for the digital image for the first member and a timestamp for the at least one member of the subset to produce a timing score for the pair, wherein the at least one tie is parameterized by the timing score for the pair.

10. The method of claim 1, wherein determining the second member associated with the document comprises a determination that the second member also has supplied the document.

11. The method of claim 1, wherein determining the second member associated with the document comprises a determination that the second member has supplied a similar document.

12. The method of claim 1, wherein the existing network is a social network.

13. The method of claim 1, further comprising storing information about the members of the existing network who supply documents in an index.

14. The method of claim 1, wherein the document is a paper document.

15. The method of claim 1, further comprising storing information corresponding to the at least one tie.

16. A computer program product for modifying tie strength between members of an existing network using a digital image of at least a portion of a document, the computer program product comprising:

a computer-readable storage medium; and

computer program code, coded on the medium and executed by at least one processor, for;

receiving the digital image of at least a portion of the document associated with a first member in the existing network;

recognizing the document associated with the first member based on the received digital image;

recognizing an x-y location of the received digital image corresponding to the at least portion of the document;

determining a second member associated with the document based at least in part on the recognized x-y location; and

modifying at least one tie between the members of the existing network with respect to the first member and the second member, wherein modifying comprises creating a tie between the first member and the second member, wherein the first member and the second member previously were not tied within the existing network, wherein modifying parameterizes member information, and wherein the created tie is parameterized by a score based on a context of the received digital image of the at least portion of the document.

17. The computer program product of claim 16, wherein modifying the at least one tie between the members of the existing network with respect to the first member and the second member comprises strengthening the tie between the first member and the second member.

18. The computer program product of claim 16, wherein recognizing the document further comprises an indexing operation that allows identification of a corresponding electronic representation of the document and associated second media types.

19. The computer program product of claim 16, wherein determining the second member associated with the document comprises a determination that the second member also has supplied the document.

20. The computer program product of claim 16, wherein determining the second member associated with the document comprises a determination that the second member has supplied a similar document.

21. A system for modifying tie strength between members of an existing network using a digital image of at least a portion of a captured document, the system comprising:

at least one processor; and

a computer-readable storage medium embedded with computer program code executed by the at least one processor, the executed computer program code comprising;

a document matching module for receiving the digital image of at least a portion of the document that is associated with a first member in the existing network, for recognizing the document associated with the first member based on the received digital image and for recognizing an x-y location of the received digital image corresponding to the at least portion of the document;

a user association module for determining a second member associated with the document based at least in part on the recognized x-y location; and

a networking module for modifying at least one tie between the members of the existing network with respect to the first member and the second member, wherein modifying comprises creating a tie between the first member and the second member, wherein the first member and the second member previously were not tied within the existing network, wherein modifying parameterizes member information, and wherein the created tie is parameterized by a score based on a context of the at least portion of the document.

22. The system of claim 21, wherein modifying the at least one tie between the members of the existing network with respect to the first member and the second member comprises strengthening the tie between the first member and the second member.

23. The system of claim 21, wherein recognizing the document further comprises an indexing operation that allows identification of a corresponding electronic representation of the document and associated second media types.

24. The system of claim 21, wherein the document is a paper document.