METHOD AND APPARATUS FOR ANNOTATING MEDIA STREAMS

• US 20070250901A1
• Filed: 03/30/2007
• Published: 10/25/2007
• Est. Priority Date: 03/30/2006
• Status: Active Grant

• Current Assignee: Tout
• Original Assignee: Tout
• Inventors: Stringer-Calvert, David W.J., McIntire, John P.
• Granted Patent: US 8,645,991 B2
• Time in Patent Office: Days
• US Class Current: 725/146
• CPC Class Codes: G01S 13/878 Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector G01S13/874 takes precedence
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2542 for selling goods, e.g. TV shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4756 for rating content, e.g. scoring a recommended movie
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04N 7/17336 : Handling of requests in head-ends

Abstract

In one embodiment, the invention is a method and apparatus for annotating media streams. One embodiment of a method for facilitating creation of an annotated media stream by a user includes receiving the media stream from the user, mapping at least one item of supplemental content to at least a portion of the media stream to produce the annotated media stream, and storing the annotated media stream. In another embodiment, a method for distributing an annotated media stream provided by a user includes receiving the annotated media stream from the user, where the annotated media stream includes at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream, storing the annotated media stream, receiving a request from a viewer to view the annotated media stream, and distributing the annotated media stream to the viewer. In another embodiment, a method for distributing an annotated media stream provided by a user includes distributing the annotated media stream to a viewer, where the annotated media stream includes at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream, and collecting a commission when the annotated media stream is viewed by the viewer. In one embodiment, the collecting requires further action on a part of the viewer (such as selection of a hyperlink contained in the at least one item of supplemental content or consummation of a commercial transaction).

Claims

1. A method for facilitating creation of an annotated media stream by a user, comprising:

receiving the media stream from the user;

mapping at least one item of supplemental content to at least a portion of the media stream to produce the annotated media stream; and

storing the annotated media stream.

2. The method of claim 1, wherein the at least one item of supplemental content is selected at least in part by the user.

3. The method of claim 1, wherein the at least one item of supplemental content is selected at least in part by one or more individuals acting under authorization of the user.

4. The method of claim 3, wherein the authorization is limited in accordance with one or more criteria specified by the user.

5. The method of claim 3, further comprising:

removing the at least one item of supplemental content from the annotated media stream in response to a request from the user.

6. The method of claim 1, wherein the at least one item of supplemental content is selected at least in part by an automated process.

7. The method of claim 6, wherein the automated process selects the at least one item of supplemental content in accordance with at least one of:

a level of popularity of the at least one item of supplemental content with viewers, a viewer'"'"'s response to the at least one item of supplemental content, a level of popularity of the media stream with viewers, an average length of time that viewers view the media stream, viewers response to the media stream, or random choice.

8. The method of claim 1, wherein the at least one item of supplemental content relates to an article, a person, or a concept, and the at least one item of supplemental content comprises at least one of:

text, audio, video, a multimedia presentation, a photograph, an image, a uniform resource locator, a computer application, data, commentary, advertising copy, a keyword, a tag, an element that encourages interactive participation by a viewer of the annotated media stream, variable data, raw data, stylized information, or a placeholder.

9. The method of claim 8, wherein the article, person or concept is depicted in or suggested by the media stream.

10. The method of claim 8, wherein the placeholder associates the portion of the annotated media stream with multiple items of similar supplemental content.

11. The method of claim 10, wherein the multiple items of supplemental content are prioritized in accordance with a hierarchy.

12. The method of claim 1, wherein the at least one item of supplemental content is created by the user.

13. The method of claim 12, further comprising:

providing tools to the user to facilitate creation of the at least one item of supplemental content.

14. The method of claim 1, wherein the at least one item of supplemental content is selected by the user from a library comprising a plurality of entries, each of the plurality of entries representing an article, a person, or a concept, and each of the plurality of entries comprising at least one item of supplemental content relating to the article, person, or concept.

15. The method of claim 14, wherein the plurality of entries is organized in accordance with at least one of:

a hierarchical structure, keywords, most recent additions, most popular entries, a commission that a seller associated with an entry is willing to pay for views of the entry, a commission that a seller associated with an entry is willing to pay for requests for further information from a viewer viewing the entry, a commission that a seller associated with an entry is willing to pay for sales referred through use of the entry, or a structure suggested by the media stream.

16. The method of claim 14, wherein at least one entry of the plurality of entries further comprises:

a price that an advertiser is willing to pay to have an item of supplemental content included in the entry mapped to at least a portion of a media stream.

17. The method of claim 14, wherein at least one entry of the plurality of entries further comprises:

an indication of a level of popularity that an item of supplemental content included in the entry has achieved with viewers.

18. The method of claim 14, wherein at least one entry of the plurality of entries further comprises:

an advisory indicating types of media streams to which an item of supplemental content included in the entry may be mapped.

19. The method of claim 14, wherein at least one entry of the plurality of entries further comprises:

demographic information about a target audience for an item of supplemental content included in the entry.

20. The method of claim 14, wherein at least a portion of the library is created by a third party source.

21. The method of claim 20, wherein the at least a portion of the library is live-linked with the third party source.

22. The method of claim 20, wherein the third party source controls access to the at least a portion of the library.

23. The method of claim 14, wherein the plurality of entries are organized according to an ontology.

24. The method of claim 14, wherein each of a plurality of items of supplemental content in at least a portion of the library conform to a common format.

25. The method of claim 14, wherein the library is at least partially accessible through a third party world wide web site.

26. The method of claim 14, wherein the library is hosted remotely.

27. The method of claim 1, wherein the at least a portion of the media stream is a temporal segment of the media stream identified by a segment identifier.

28. The method of claim 27, wherein the segment identifier is unique relative to segment identifiers identifying other temporal segments of the media stream.

29. The method of claim 1, wherein the at least one item of supplemental content includes embedded descriptive characteristics.

30. The method of claim 1, further comprising:

receiving bids from third parties for a right to contribute an item of supplemental content for mapping to the at least a portion of the media stream; and

awarding the right to one or more of the third parties in accordance with the received bids.

31. The method of claim 1, wherein the annotated media stream comprises at least one of:

a video component, an audio component, or a text component.

32. The method of claim 1, wherein the method executes in accordance with a local application on a computing device.

33. The method of claim 1, wherein the method executes in accordance with a world wide web-based application.

34. The method of claim 1, further comprising:

removing the at least one item of supplemental content from the annotated media stream in response to a request from a provider of the at least one item of supplemental content.

35. A computer readable medium containing an executable program for facilitating creation of an annotated media stream by a user, where the program performs the steps of:

receiving the media stream from the user;

mapping at least one item of supplemental content to at least a portion of the media stream to produce the annotated media stream; and

storing the annotated media stream.

36. System for facilitating creation of an annotated media stream by a user, comprising:

means for receiving the media stream from the user;

means for mapping at least one item of supplemental content to at least a portion of the media stream to produce the annotated media stream; and

means for storing the annotated media stream.

37. A method for distributing an annotated media stream provided by a user, comprising:

receiving the annotated media stream from the user, the annotated media stream comprising at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream;

storing the annotated media stream;

receiving a request from a viewer to view the annotated media stream; and

distributing the annotated media stream to the viewer.

38. The method of claim 37, wherein the at least one item of supplemental content relates to an article, a person, or a concept, and the at least one item of supplemental content comprises at least one of:

text, audio, video, a multimedia presentation, a photograph, an image, a uniform resource locator, a computer application, data, commentary, advertising copy, a keyword, a tag, an element that encourages interactive participation by the viewer, variable data, raw data, stylized information, or a placeholder.

39. The method of claim 38, wherein the article, person or concept is depicted in or suggested by the media stream.

40. The method of claim 37, wherein the at least one item of supplemental content is displayed simultaneously with the at least a portion of the media stream.

41. The method of claim 40, wherein the at least one item of supplemental content and the media stream are displayed in separate viewing panes of a common display.

42. The method of claim 37, wherein the at least one item of supplemental content is displayed after the media stream has concluded.

43. The method of claim 37, wherein the media stream and the at least one item of supplemental content are distributed to separate platforms.

44. The method of claim 37, further comprising:

receiving a signal from the viewer in response to the at least one item of supplemental content.

45. The method of claim 44, further comprising:

logging the viewer signal.

46. The method of claim 45, further comprising:

reporting the viewer signal to at least one of;

the user or a provider of the at least one item of supplemental content.

47. The method of claim 46, further comprising:

collecting a commission for the reporting of the viewer signal.

48. The method of claim 44, further comprising:

providing information to the viewer in response to the signal, the information relating to the at least one item of supplemental content.

49. The method of claim 45, further comprising:

logging a viewer response to the information provided.

50. The method of claim 45, further comprising:

providing the viewer signal to at least one of;

the user or a provider of the at least one item of supplemental content.

51. The method of claim 37, wherein the annotated media stream comprises at least one of:

a video component, an audio component, or a text component.

52. The method of claim 37, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least a portion of the media stream, the selection being based at least in part on information relating to the viewer.

53. The method of claim 52, wherein the information relating to the viewer comprises at least one of:

demographic information about the viewer, information about past viewing habits of the viewer, information about past interactions the viewer has had with other items of supplemental content, a number of times the viewer has viewed the annotated media stream, an average time for which the viewer has viewed other media streams, viewer preferences as expressed by the viewer and learned viewer preferences.

54. The method of claim 37, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least a portion of the media stream, the selection being based at least in part on a device on which the annotated media stream is displayed.

55. The method of claim 37, wherein the at least one item of supplemental content is randomly selected from among a plurality of potential items of supplemental content mapped to the at least a portion of the media stream.

56. The method of claim 37, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least a portion of the media stream, the selection being based on a rotating schedule.

57. The method of claim 56, wherein after cycling through the rotating schedule a number of times, the selection is based at least in part on viewer response to the plurality of potential items of supplemental content.

58. The method of claim 57, wherein the selection is based at least in part on which of the plurality of items supplemental of supplemental content generated a highest degree of viewer interest.

59. The method of claim 37, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least a portion of the media stream, the selection being based at least in part on a context in which the displaying takes place.

60. The method of claim 37, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least a portion of the media stream, the selection being based at least in part on a general tone of the at least a portion of the media stream.

61. The method of claim 37, further comprising:

sending the at least one item of supplemental content to a remote device for later viewing by the viewer.

62. The method of claim 37, further comprising:

displaying banner advertising with the displayed annotated media stream on a common display device, where content of the banner advertising is selected in accordance with at least one of;

a keyword associated with the annotated media stream, a target demographic of the annotated media stream, the at least one item of supplemental content, a position of the at least one item of supplemental content within a hierarchy of a library of supplemental content, or information about the viewer.

63. The method of claim 37, wherein the media stream and the at least one item of supplemental content are retrieved from different sources prior to the displaying.

64. The method of claim 37, further comprising:

detecting that the viewer is fast forwarding through the annotated media stream; and

replacing the at least one item of supplemental content with a replacement item that is more easily viewable during fast forwarding.

65. A computer readable medium containing an executable program for distributing an annotated media stream provided by a user, where the program performs the steps of:

receiving the annotated media stream from the user, the annotated media stream comprising at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream;

storing the annotated media stream;

receiving a request from a viewer to view the annotated media stream; and

distributing the annotated media stream to the viewer.

66. System for distributing an annotated media stream provided by a user, comprising:

means for receiving the annotated media stream from the user, the annotated media stream comprising at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream;

storing the annotated media stream;

receiving a request from a viewer to view the annotated media stream; and

means for distributing the annotated media stream to the viewer.

67. A method for distributing an annotated media stream provided by a user, comprising:

distributing the annotated media stream to a viewer, the annotated media stream comprising at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream; and

collecting a commission when the annotated media stream is viewed by the viewer.

68. The method of claim 67, wherein the collecting requires further action on a part of the viewer.

69. The method of claim 68, wherein the further action is selection of a hyperlink contained in the at least one item of supplemental content.

70. The method of claim 68, wherein the further action is consummation of a commercial transaction.

71. The method of claim 67, further comprising:

providing at least a portion of the commission to the user.

72. The method of claim 71, wherein an amount of the at least a portion of the commission is calculated, at least in part, based on a number of times the annotated media stream has been viewed.

73. The method of claim 67, further comprising:

providing at least a portion of the commission to one or more individuals who selected the at least one item of supplemental content for mapping.

74. The method of claim 73, wherein allocation of the at least a portion of the commission among the one or more individuals is dictated by the one or more individuals.

75. The method of claim 67, further comprising:

providing at least a portion of the commission to a contributor of the at least one item of supplemental content.

76. The method of claim 67, wherein the commission is a monetary commission.

77. The method of claim 67, wherein the commission is in the form of a redeemable coupon or credit.

78. The method of claim 67, wherein the commission is collected from a provider of the at least one item of supplemental content.

79. The method of claim 67, wherein the commission is collected from a seller of an article represented by the at least one item of supplemental content.

80. The method of claim 67, wherein the at least one item of supplemental content relates to an article, a person, or a concept, and the at least one item of supplemental content comprises at least one of:

text, audio, video, a multimedia presentation, a photograph, an image, a uniform resource locator, a computer application, data, commentary, advertising copy, a keyword, a tag, an element that encourages interactive participation by the viewer, variable data, raw data, stylized information, or a placeholder.

81. The method of claim 80, wherein the article, person or concept is depicted in or suggested by the media stream.

82. The method of claim 67, wherein an amount of the commission is dictated by a provider of the commission prior to the viewer viewing the annotated media stream.

83. A computer readable medium containing an executable program for distributing an annotated media stream provided by a user, where the program performs the steps of:

distributing the annotated media stream to a viewer, the annotated media stream comprising at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream; and

collecting a commission when the annotated media stream is viewed by the viewer.

84. System for distributing an annotated media stream provided by a user, comprising:

means for distributing the annotated media stream to a viewer, the annotated media stream comprising at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream; and

means for collecting a commission when the annotated media stream is viewed by the viewer commission when the annotated media stream is viewed by a viewer.