Method and apparatus for providing community-based metadata

• US 8,527,537 B2
• Filed: 09/03/2010
• Issued: 09/03/2013
• Est. Priority Date: 02/19/2009
• Status: Active Grant

• Current Assignee: Hulu LLC (The Walt Disney Company)
• Original Assignee: Hulu LLC (The Walt Disney Company)
• Inventors: Wang, Zhibing, Liao, Yupeng
• Primary Examiner(s): LE, THU NGUYET T
• Application Number:
  US12/875,775
• Publication Number:
  US 20100332527A1
• Time in Patent Office: 1,096 Days
• Field of Search: 707/769, 707/802, 707/916
• US Class Current: 707/769
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings

Abstract

A method and apparatus for providing community based metadata is disclosed. In one embodiment, the method comprises the steps of detecting an object in a frame of media program, transmitting first data comprising the frame of the media program having the detected object to display device for presentation to a user, receiving second data comprising user entered metadata associated with the identified object, tracking the object across proximate frames of the media program, associating the entered metadata with the object in at least one of the proximate frames of the media program, and storing the associated entered metadata.

Claims

1. A method of obtaining metadata associated with a media program, comprising the steps of:

detecting an object in a frame of the media program;

transmitting first data comprising the frame of the media program having the object to a display device for presentation to a first user, wherein the first user is viewing the media program through a video delivery service offering delivery of the media program;

receiving user entered metadata from the first user for the object in the frame;

tracking the object to determine proximate frames to the frame in which the object appears across the proximate frames of the media program;

automatically associating the user entered metadata from the first user with the object in the frame with at least one of the proximate frames of the media program in response to receiving the user entered metadata from the first user and the determination of the proximate frames the object appeared across without user input indicating the first user entered metadata should be associated with the object in the proximate frames;

comparing the user entered metadata from the first user with user entered metadata from second users for the object;

verifying that the user entered metadata from the first user and the second users should be associated as additional metadata for the object in the media program based on the comparison; and

upon verifying, associating the user entered metadata for the frame and the at least one of the proximate frames with the media program, wherein the associated user entered metadata is usable to provide a search result identifying the media program, and wherein a thumbnail of one of the frame and the proximate frames that depicts the object is determined from the user-entered metadata and used to identify the media program.

2. The method of claim 1, wherein the step of receiving the user entered metadata from the first user for the object comprises the steps of:

receiving a first user selection of the object from the display device; and

transmitting second data comprising an interface to the display device for user entry of the user entered metadata associated with the object.

3. The method of claim 2, wherein the second data comprises the user entered metadata from the second users for the object entered by the second users.

4. The method of claim 2, wherein the second data comprises a presumptive metadata associated with the object and the user entered metadata from the first user comprises a confirmation of the presumptive metadata.

5. The method of claim 1, wherein:

the frame comprises a delineation of the object.

6. The method of claim 5, wherein the delineation comprises reticules proximate the object.

7. The method of claim 1, wherein the first data comprises a plurality of frames including the transmitted frame, the plurality of frames together presenting moving images of the media program.

8. The method of claim 1, wherein the frame is a thumbnail comprising only one object.

9. The method of claim 8, wherein the thumbnail is transmitted in response to a metadata search, and the frame is selected so as to comprise the one object and no additional objects.

10. The method of claim 9, wherein the metadata search is for a performer depicted in the media program.

11. The method of claim 1, wherein the received user entered metadata from the first user comprises user entered metadata from the first user identifying the object.

12. The method of claim 1, wherein the object is a performer depicted in the media program and the user entered metadata from the first user identifies the performer.

13. The method of claim 1, further comprising storing the user entered metadata from the first user upon verifying the user entered metadata.

14. The method of claim 1, wherein verifying comprises:

comparing a number of users counted from the first user and the second users that identified the object in the user entered metadata to a threshold; and

verifying the user entered metadata when the number of users is above the threshold.

15. An apparatus for obtaining metadata associated with a media program, comprising:

one or more computer processors; and

a non-transitory computer-readable storage medium comprising instructions, that when executed, control the one or more computer processors to be configured for;

detecting an object in a frame of the media program and for tracking the object to determine proximate frames to the frame in which the object appears across the proximate frames of the media program;

transmitting first data comprising the frame of the media program having the object to a display device for presentation to a first user, wherein the first user is viewing the media program through a video delivery service offering delivery of the media program;

receiving user entered metadata from the first user for the object in the frame;

automatically associating the user entered metadata from the first user with the object in the frame with at least one of the proximate frames of the media program in response to receiving the user entered metadata from the first user and the determination of the proximate frames the object appeared across without user input indicating the first user entered metadata should be associated with the object in the proximate frames;

comparing the user entered metadata from the first user with user entered metadata from second users for the object;

verifying that the user entered metadata from the first user and the second users should be associated as additional metadata for the object in the media program based on the comparison; and

upon verifying, associating the user entered metadata for the frame and the at least one of the proximate frames with the media program, wherein the associated user entered metadata is usable to provide a search result identifying the media program, and wherein a thumbnail of one of the frame and the proximate frames that depicts the object is determined from the user-entered metadata and used to identify the media program.

16. The apparatus of claim 15, further configured for receiving a user selection of the object from the display device, and transmitting second data comprising an interface to the display device for user entry of the user entered metadata from the first user associated with the object.

17. The apparatus of claim 16, wherein the second data comprises user entered metadata from the second users for the object entered by the second users.

18. The apparatus of claim 16, wherein the second data comprises a presumptive metadata associated with the object and the user entered metadata from the first user comprises a confirmation of the presumptive metadata.

19. The apparatus of claim 15, wherein the frame comprises a delineation of the object.

20. The apparatus of claim 19, wherein the delineation comprises reticules proximate the object.

21. The apparatus of claim 15, wherein the first data comprises a plurality of frames including the transmitted frame, the plurality of frames together presenting moving images of the media program.

22. The apparatus of claim 15, wherein the frame is a thumbnail comprising only one object.

23. The apparatus of claim 22 wherein the thumbnail is transmitted in response to a metadata search, and the frame is selected so as to comprise the one object and no additional objects.

24. The apparatus of claim 23, wherein the metadata search is for a performer depicted in the media program.

25. The apparatus of claim 15, wherein the received user entered metadata from the first user comprises user entered metadata from the first user identifying the object.

26. The apparatus of claim 15, wherein the object is a performer depicted in the media program and the user entered metadata from the first user identifies the performer.

27. The apparatus of claim 15, further configured for storing the user entered metadata from the first user upon verifying the user entered metadata.

28. The apparatus of claim 15, wherein verifying comprises:

comparing a number of users counted from the first user and the second users that identified the object in the user entered metadata to a threshold; and

verifying the user entered metadata when the number of users is above the threshold.

29. A non-transitory computer-readable storage medium containing instructions for obtaining metadata associated with a media program, the instructions when executed, control a computer system to be configured for:

detecting an object in a frame of the media program;

transmitting first data comprising the frame of the media program having the object to a display device for presentation to a first user, wherein the first user is viewing the media program through a video delivery service offering delivery of the media program;

receiving user entered metadata from the first user for the object in the frame;

tracking the object to determine proximate frames to the frame in which the object appears across the proximate frames of the media program;

automatically associating the user entered metadata from the first user with the object in the frame with at least one of the proximate frames of the media program in response to receiving the user entered metadata from the first user and the determination of the proximate frames the object appeared across without user input indicating the user entered metadata should be associated with the object in the proximate frames;

comparing the user entered metadata from the first user with user entered metadata from second users for the object;

verifying that the user entered metadata from the first users and the second users should be associated as additional metadata for the object in the media program based on the comparison; and

associating the user entered metadata for the frame and the at least one of the proximate frames with the media program, wherein the associated user entered metadata is usable to provide a search result identifying the media program, and wherein a thumbnail of one of the frame and the proximate frames that depicts the object is determined from the user-entered metadata and used to identify the media program.

30. The apparatus of claim 29, wherein the step of receiving the user entered metadata from the first user for the object comprises:

receiving a user selection of the object from the display device; and

transmitting second data comprising an interface to the display device for user entry of the user entered metadata from the first user for the object.

31. The apparatus of claim 30, wherein the second data comprises the user entered metadata from the second users for the object entered by the second users.

32. The apparatus of claim 30, wherein the second data comprises a presumptive metadata associated with the object and the user entered metadata from the first user comprises a confirmation of the presumptive metadata.

33. The apparatus of claim 29, wherein the frame comprises a delineation of the object.

34. The apparatus of claim 33, wherein the delineation comprises reticules proximate the object.

35. The apparatus of claim 29, wherein the first data comprises a plurality of frames including the transmitted frame, the plurality of frames together presenting moving images of the media program.

36. The apparatus of claim 29, wherein the frame is a thumbnail comprising only one object.

37. The apparatus of claim 36, wherein the thumbnail is transmitted in response to a metadata search, and the frame is selected so as to comprise the one object and no additional objects.

38. The apparatus of claim 37, wherein the metadata search is for a performer depicted in the media program.

39. The apparatus of claim 29, wherein the received user entered metadata from the first user comprises user entered metadata from the first user identifying the object.

40. The apparatus of claim 29, wherein the object is a performer depicted in the media program and the user entered metadata from the first user identifies the performer.

41. The apparatus of claim 29, further comprising the step of storing the user entered metadata from the first user upon verifying the user entered metadata.

42. The non-transitory computer-readable storage medium of claim 29, wherein verifying comprises:

comparing a number of users counted from the first user and the second users that identified the object in the user entered metadata to a threshold; and

verifying the user entered metadata when the number of users is above the threshold.