Context-based community-driven suggestions for media annotation

• US 7,739,304 B2
• Filed: 02/08/2007
• Issued: 06/15/2010
• Est. Priority Date: 02/08/2007
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Yang, Jeannie Hui-I, King, Simon P., Davis, Marc E., Naaman, Mor, Nair, Rahul, Ahern, Shane P.
• Primary Examiner(s): Vital; Pierre M
• Assistant Examiner(s): OBISESAN, AUGUSTINE KUNLE
• Application Number:
  US11/672,901
• Publication Number:
  US 20080195657A1
• Time in Patent Office: 1,223 Days
• Field of Search: None
• US Class Current: 707/784
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata

Abstract

Disclosed are apparatus and methods for facilitating annotation of media objects by a user. Mechanisms present a user with an easily usable set of annotation suggestions that are most likely to be relevant to the particular user and/or media context. In general, existing annotations are analyzed to determine a set of suggested annotations. Annotation suggestions for a particular user are based on an analysis of the relevance, to the particular user, of existing annotations of one or more media objects so that the most likely relevant annotations are presented as suggested annotations. In particular embodiments, this analysis depends on whether the existing annotations were created and/or selected by the particular user, a member of the particular user'"'"'s social network, or members of the general public.

Claims

1. A method of facilitating photograph annotation, comprising:

(a) for a particular photograph object on a device and associated with a particular user identifier (ID) of a particular user, in a photo object repository searching for the particular user ID that has been previously associated with a first set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object and searching for one or more other user IDs that have been identified by the particular user as belonging to the particular user'"'"'s social network and that are associated with a second set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object and searching for one or more general public user IDs that have not been identified by the user as belonging to the particular user'"'"'s social network and that are associated with a third set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object;

(b) ordering the first set, second set, and third set of existing annotations into a ranked list of annotations, wherein the first set of existing annotations is ranked higher in the ranked list than the second set of existing annotations, and wherein the third set of existing annotations is ranked lower than the first and second sets of existing annotations in the ranked list of annotations, wherein ordering is further accomplished by;

assigning different weight values to existing annotations that are within different predefined time periods, wherein the weight values are higher for more recent time periods than for less recent time periods or for one or more specific time periods,

determining a total of the weighted counts of each similar annotation from the existing annotations, and

ranking the totals from highest total to lowest total to form the ranked list of suggested annotations; and

(c) presenting at the device a highest ranked and ordered subset of the ranked list of annotations to the particular user as a list of suggested annotations that are selectable by the particular user to annotate the particular photograph object.

2. A method as recited in claim 1, further comprising periodically repeating operations (a) through (c) for the particular user so as to dynamically update the list of suggested annotations based on the context and the social community of the particular, user as changes occur to the set of existing annotations.

3. A method as recited in claim 2, wherein operations (a) through (c) are repeated after expiration of a predefined time period, when the particular user changes a location, or when a user initiates operations (a) through (c).

4. A method as recited in claim 1, wherein at least a subset of the first and second set of the existing annotations are associated with multiple sources.

5. A method as recited in claim 4, wherein the multiple sources include two or more of a media object organization source, a personal media object collection, source, a web-based media object collection source, a blog source, or a webpage source.

6. A method as recited in claim 1, wherein each annotation of the ranked list of annotations is associated with a current location of the particular user.

7. A method as recited in claim 6, wherein the ranked list of annotations is further based on prioritizing the existing annotations into increasing levels of relevance based on how recently in time the existing annotations were selected or used.

8. A method as recited in claim 1, wherein the ranked list of annotations is further based on parsing through at least some of the existing annotations to extract text that is suitable for annotating or describing a media object.

9. A method as recited in claim 1, wherein the suggested annotations are presented in a manner that is based on the type, of device on which the suggested annotations are being presented.

10. A method as recited in claim 1, wherein searching and ordering of the first and second sets of the existing annotations are performed without requiring that the existing annotations have a fixed format or belong to a fixed category.

11. A method as recited in claim 1, wherein presenting the suggested annotations includes storing the suggested annotations for access by the particular user.

12. A method as recited in claim 1, wherein presenting the suggested annotations includes displaying the suggested annotations on a display of the device.

13. A method as recited in claim 1, further comprising receiving a selection of a particular annotation by the particular user, wherein the particular user selects the particular annotation from the list of suggested annotations by clicking on or checking the particular annotation with a mouse, stylus or other input mechanism, dragging the particular annotation to the particular photograph object, entering a combination of letters for the particular annotation via a number pad of a portable or cellular phone, entering only a subset of the letters of the particular annotation via the number pad whereby the remaining letters are automatically completed, or entering the letters of the particular annotation by only tapping each number button one time whereby the particular annotation is automatically determined.

14. An apparatus for facilitating photograph annotation, comprising:

at least one a processor; and

at least one memory, the at least one processor and/or memory being configured for;

(a) for a particular photograph object on the apparatus and associated with a particular user identifier (ID) of a particular user, in a photo object repository searching for the particular user ID that has been previously associated with a first set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object and searching for one or more other user IDs that have been identified by the particular user as belonging to the particular user'"'"'s social network and that are associated with a second set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object and searching for one or more general public user IDs that have not been identified by the user as belonging to the particular user'"'"'s social network and that are associated with a third set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object;

(b) ordering the first set, second set, and third set of existing annotations into a ranked list of annotations, wherein the first set of existing annotations is ranked higher in the ranked list than the second set of existing annotations and wherein the third set of existing annotations is ranked lower than the first and second sets of existing annotations in the ranked list of annotations, wherein ordering is further accomplished by;

assigning different weight values to existing annotations that are within different predefined time periods, wherein the weight values are higher for more recent time periods than for less recent time periods or for one or more specific time periods,

determining a total of the weighted counts of each similar annotation from the existing annotations, and

ranking the totals from highest total to lowest total to form the ranked list of suggested annotations; and

(c) presenting a highest ranked and ordered subset of the ranked list of annotations to the particular user as a list of suggested annotations that are selectable by the particular user to annotate the particular photograph object, web-based media object collection source, a blog source, or a webpage source.

15. An apparatus as recited in claim 14, the at least one processor and/or memory being further configured for periodically repeating operations (a) through (c) for the particular user so as to dynamically update the list of suggested annotations based on the context and the social community of the particular user as changes occur to the set of existing annotations.

16. An apparatus as recited in claim 14, wherein at least a subset of the first and second set of the existing annotations are associated with multiple sources.

17. An apparatus as recited in claim 16, wherein the multiple sources include two or more of a media object organization source, a personal media object collection source, a web-based media object collection source, a blog source, or a webpage source.

18. An apparatus as recited in claim 14, wherein each annotation of the ranked list of annotations is associated with a current location of the particular user.

19. An apparatus as recited in claim 18, wherein the ranked list of annotations is further based on prioritizing the existing annotations into increasing levels of relevance based on how recently in time the existing annotations were selected or used.

20. An apparatus as recited in claim 14, wherein the ranked list of annotations is further based on parsing through at least some of the existing annotations to extract text that is suitable for annotating or describing a media object.

21. An apparatus as recited in claim 14, wherein the suggested annotations are presented in a manner that is based on the type of device on which the suggested annotations are being presented.

22. An apparatus as recited in claim 14, wherein searching and ordering of the first and second sets of the existing annotations are performed without requiring that the existing annotations have a fixed format or belong to a fixed category.

23. At least one computer readable storage medium having computer program instructions stored thereon that are arranged to perform the following operations:

(a) for a particular photograph object on a device and associated with a particular user identifier (ID) of a particular user, in a photo object repository searching for the particular user ID that has been previously associated with a first set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object and searching for one or more other user IDs that have been identified by the particular user as belonging to the particular user'"'"'s social network and that are associated with a second set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object and searching for one or more general public user IDs that have not been identified by the user as belonging to the particular user'"'"'s social network and that are associated with a third set of existing annotations of a plurality of previously annotated photograph objects that relates to a context of the particular photograph object;

(b) ordering the first set, second set, and third set of existing annotations into a ranked list of annotations, wherein the first set of existing annotations is ranked higher in the ranked list than the second set of existing annotations and wherein the third set of existing annotations is ranked lower than the first and second sets of existing annotations in the ranked list of annotations, wherein ordering is further accomplished by;

assigning different weight values to existing annotations that are within different predefined time periods, wherein the weight values are higher for more recent time periods than for less recent time periods or for one or more specific time periods,

determining a total of the weighted counts of each similar annotation from the existing annotations, and

ranking the totals from highest total to lowest total to form the ranked list of suggested annotations; and

(c) presenting at the device a highest ranked and ordered subset of the ranked list of annotations to the particular user as a list of suggested annotations that are selectable by the particular user to annotate the particular photograph object.

24. At least one computer readable storage medium as recited in claim 23, the computer program instructions Previously presented being further arranged to periodically repeat operations (a) through (c) for the particular user so as to dynamically update the list of suggested annotations based on the context and the social community of the particular user as changes occur to the set of existing annotations.

25. At least one computer readable storage medium as recited in claim 24, wherein the computer program instructions are further arranged to periodically repeat operations (a) through (c) after expiration of a predefined time period, when the particular user changes a location, or when a user initiates operations (a) through (c).

26. At least one computer readable storage medium as recited in claim 23, wherein at least a subset of the first and second set of the existing annotations are associated with multiple sources.

27. At least one computer readable storage medium as recited in claim 26, wherein the multiple sources include two or more of a media object organization source, a personal media object collection source, a web-based media object collection source, a blog source, or a webpage source.

28. At least one computer readable storage medium as recited in claim 23, wherein each annotation of the ranked list of annotations is associated with a current location of the particular user.

29. At least one computer readable storage medium as recited in claim 28, wherein the ranked list of annotations is further based on prioritizing the existing annotations into increasing levels of relevance based on how recently in time the existing annotations were selected or used.

30. At least one computer readable storage medium as recited in, claim 23, wherein the ranked list of annotations is further based on parsing through at least some of the existing annotations to extract text that is suitable for annotating or describing a media object.

31. At least one computer readable storage medium as recited in claim 23, wherein the suggested annotations are presented in a manner that is based on the type of device on which the suggested annotations are being presented.

32. At least one computer readable storage medium as recited in claim 23, wherein searching and ordering of the first and second sets of the existing annotations are performed without requiring that the existing annotations have a fixed format or belong to a fixed category.

33. At least one computer readable storage medium as recited in claim 23, the computer program instructions stored thereon being further arranged to receive a selection of a particular annotation by the particular user, wherein the particular user selects the particular annotation from the list of suggested annotations by clicking on or checking the particular annotation with a mouse, stylus or other input mechanism, dragging the particular annotation to the particular photograph object, entering a combination of letters for the particular annotation via a number pad of a portable or cellular phone, entering only a subset of the letters of the particular annotation via the number pad whereby the remaining letters are automatically completed, or entering the letters of the particular annotation by only tapping each number button one time whereby the particular annotation is automatically determined.