Method and apparatus for annotating media streams

• US 8,645,991 B2
• Filed: 03/30/2007
• Issued: 02/04/2014
• Est. Priority Date: 03/30/2006
• Status: Active Grant

• Current Assignee: Tout
• Original Assignee: Tout Industries, Inc.
• Inventors: McIntire, John P., Stringer-Calvert, David W. J.
• Primary Examiner(s): Le, Rong
• Application Number:
  US11/694,836
• Publication Number:
  US 20070250901A1
• Time in Patent Office: 2,503 Days
• Field of Search: None
• US Class Current: 725/34
• CPC Class Codes: G01S 13/878 Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector G01S13/874 takes precedence
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2542 for selling goods, e.g. TV shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4756 for rating content, e.g. scoring a recommended movie
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04N 7/17336 : Handling of requests in head-ends

Abstract

In one embodiment, the invention is a method and apparatus for annotating media streams. One embodiment of a method for facilitating creation of an annotated media stream by a user includes receiving the media stream from the user, mapping at least one item of supplemental content to at least a portion of the media stream to produce the annotated media stream, and storing the annotated media stream. In another embodiment, a method for distributing an annotated media stream provided by a user includes receiving the annotated media stream from the user, where the annotated media stream includes at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream, storing the annotated media stream, receiving a request from a viewer to view the annotated media stream, and distributing the annotated media stream to the viewer. In another embodiment, a method for distributing an annotated media stream provided by a user includes distributing the annotated media stream to a viewer, where the annotated media stream includes at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream, and collecting a commission when the annotated media stream is viewed by the viewer. In one embodiment, the collecting requires further action on a part of the viewer (such as selection of a hyperlink contained in the at least one item of supplemental content or consummation of a commercial transaction).

Claims

1. A method for distributing an annotated media stream created by a first user, comprising:

selecting a media stream under instruction from the first user, wherein the media stream is associated with an index of one or more segment identifiers that are associated with one or more segments of the media stream;

selecting at least one item of supplemental content under instruction from the first user;

mapping the at least one item of supplemental content to at least one of the one or more segment identifiers, such that the media stream remains substantially unaltered, wherein the mapping is performed under instruction of the first user to produce a mapping;

storing the media stream and the mapping;

receiving a first request from a second user, different from the first user, to view the media stream;

distributing the media stream and the mapping over a network to a first display device operated by the second user, wherein the media stream and the mapping produce the annotated media stream when utilized together, such that the at least one item of supplemental content and a segment of the one or more segments of the media stream indicated by the one or more segment identifiers are displayed simultaneously in a time-synchronized manner such that the at least one item of supplemental content relates to a localized context specific to the segment, where the at least one item of supplemental content and the segment are displayed in separate, non-overlapping viewing panes;

separating the at least one item of supplemental content from the media stream;

sending the at least one item of supplemental content, independent of the media stream, to a second display device operated by the second user for later viewing without requiring an input from the second user or from the second display device;

collecting a commission when the annotated media stream is viewed by the second user;

providing a first portion of the commission to the first user, wherein an amount of the first portion of the commission is calculated, at least in part, based on a number of times the annotated media stream has been viewed; and

providing a second portion of the commission to one or more individuals who selected the at least one item of supplemental content for mapping, wherein an allocation of the second portion of the commission among the one or more individuals is dictated by the one or more individuals.

2. The method of claim 1, wherein the at least one item of supplemental content relates to an article, a person, or a concept, and the at least one item of supplemental content comprises at least one of:

text, audio, video, a multimedia presentation, a photograph, an image, a uniform resource locator, a computer application, data, commentary, advertising copy, a keyword, a tag, an element that encourages interactive participation by the viewer, variable data, raw data, stylized information, or a placeholder.

3. The method of claim 2, wherein the article, person or concept is depicted in or suggested by the media stream.

4. The method of claim 1, wherein the at least one item of supplemental content is displayed after the media stream has concluded.

5. The method of claim 1, further comprising:

receiving a first signal from the second user in response to the at least one item of supplemental content.

6. The method of claim 5, further comprising:

logging the first signal.

7. The method of claim 6, further comprising:

reporting the first signal to at least one of;

the first user or a provider of the at least one item of supplemental content.

8. The method of claim 5, further comprising:

providing information to the second user in response to the first signal, the information relating to the at least one item of supplemental content.

9. The method of claim 6, further comprising:

logging a response of the second user to the information provided as a second signal.

10. The method of claim 9, further comprising:

providing the second signal to at least one of;

the first user or a provider of the at least one item of supplemental content.

11. The method of claim 1, wherein the annotated media stream comprises at least one of:

a video component, an audio component, or a text component.

12. The method of claim 1, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least one of the one or more segment identifiers, a selection of the at least one item of supplemental content being based at least in part on information relating to the second user.

13. The method of claim 12, wherein the information relating to the second user comprises at least one of:

demographic information about the second user, information about past viewing habits of the second user, information about past interactions the second user has had with other items of supplemental content, a number of times the second user has viewed the annotated media stream, an average time for which the second user has viewed other media streams, second user preferences as expressed by the second user and learned second user preferences.

14. The method of claim 1, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least one of the one or more segment identifiers, a selection of the at least one item of supplemental content being based at least in part on a device on which the annotated media stream is displayed.

15. The method of claim 1, wherein the at least one item of supplemental content is randomly selected from among a plurality of potential items of supplemental content mapped to the at least one of the one or more segment identifiers.

16. The method of claim 1, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least one of the one or more segment identifiers, a selection of the at least one item of supplemental content being based on a rotating schedule.

17. The method of claim 16, wherein after cycling through the rotating schedule a number of times, the selection is based at least in part on a response of the second user to the plurality of potential items of supplemental content.

18. The method of claim 17, wherein the selection is based at least in part on which of the plurality of items supplemental of supplemental content generated a highest degree of viewer interest.

19. The method of claim 1, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least one of the one or more segment identifiers, a selection of the at least one item of supplemental content being based at least in part on a context in which the displaying takes place.

20. The method of claim 1, wherein the at least one item of supplemental content is selected from among a plurality of potential items of supplemental content mapped to the at least one of the one or more segment identifiers, a selection of the at least one item of supplemental content being based at least in part on a general tone of the at least a portion of the media stream.

21. The method of claim 1, further comprising:

displaying banner advertising with the displayed annotated media stream on a common display device, where content of the banner advertising is selected in accordance with at least one of;

a keyword associated with the annotated media stream, a target demographic of the annotated media stream, the at least one item of supplemental content, a position of the at least one item of supplemental content within a hierarchy of a library of supplemental content, or information about the second user.

22. The method of claim 1, wherein the media stream and the at least one item of supplemental content are retrieved from different sources prior to the displaying.

23. The method of claim 1, further comprising:

detecting that the second user is fast forwarding through the annotated media stream; and

replacing the at least one item of supplemental content with a replacement item that is more easily viewable during fast forwarding.

24. The method of claim 1, wherein the selecting the media stream comprises:

receiving the media stream from the first user over a network.

25. The method of claim 1, wherein the separate, non-overlapping viewing panes are displayed on a common display.

26. The method of claim 25, wherein a viewing pane of the separate, non-overlapping viewing panes in which the segment of the media stream is displayed has a frame size that remains substantially consistent throughout a display of the media stream.

27. A non-transitory computer readable medium containing an executable program for distributing an annotated media stream created by a first user, where the program performs steps of:

selecting a media stream under instruction from the first user, wherein the media stream is associated with an index of one or more segment identifiers that are associated with one or more segments of the media stream;

selecting at least one item of supplemental content under instruction from the first user;

mapping the at least one item of supplemental content to at least one of the one or more segment identifiers, such that the media stream remains substantially unaltered, wherein the mapping is performed under instruction of the first user to produce a mapping;

storing the media stream and the mapping;

receiving a first request from a second user, different from the first user, to view the media stream;

distributing the media stream and the mapping over a network to a first display device operated by the second user, wherein the media stream and the mapping produce the annotated media stream when utilized together, such that the at least one item of supplemental content and a segment of the one or more segments of the media stream indicated by the one or more segment identifiers are displayed simultaneously in a time-synchronized manner such that the at least one item of supplemental content relates to a localized context specific to the segment, wherein the at least one item of supplemental content and the segment are displayed in separate, non-overlapping viewing panes;

separating the at least one item of supplemental content from the media stream;

sending the at least one item of supplemental content, independent of the media stream, to a second display device operated by the second user for later viewing without requiring an input from the second user or from the second display device;

collecting a commission when the annotated media stream is viewed by the second user;

providing a first portion of the commission to the first user, wherein an amount of the first portion of the commission is calculated, at least in part, based on a number of times the annotated media stream has been viewed; and

providing a second portion of the commission to one or more individuals who selected the at least one item of supplemental content for mapping, wherein an allocation of the second portion of the commission among the one or more individuals is dictated by the one or more individuals.

28. System for distributing an annotated media stream created by a first user, comprising:

a first user device for selecting a media stream and at least one item of supplemental content under instruction from the first user, wherein the media stream is associated with an index of one or more segment identifiers that are associated with one or more segments of the media stream, and wherein the first user device is also for mapping the at least one item of supplemental content to at least one of the one or more segment identifiers, such that the media stream remains substantially unaltered, wherein the mapping is performed under instruction of the first user to produce a mapping;

a server for storing the media stream and the mapping, the server being further configured for receiving a first request from a second user device, different from the first user device, to view the media stream and for distributing the media stream and the mapping to the second user device over a network, wherein the media stream and the mapping produce the annotated media stream when utilized together, such that the at least one item of supplemental content and a segment of the one or more segments of the media stream indicated by the one or more segment identifiers are displayed simultaneously in a time-synchronized manner such that the at least one item of supplemental content relates to a localized context specific to the segment, where the at least one item of supplemental content and the segment are displayed in separate, non-overlapping viewing panes, the server being further configured for separating the at least one item of supplemental content from the media stream and sending the at least one item of supplemental content, independent of the media stream, to a third user device different from the first user device and the second user device without requiring a user input or a signal from the third user device and wherein the server is also for collecting a commission when the annotated media stream is viewed on the second user device and for providing a first portion of the commission to the first user and a second portion of the commission to one or more individuals who selected the at least one item of supplemental content for mapping, wherein an amount of the first portion of the commission is calculated based at least in part on a number of times the annotated media stream has been viewed, and an allocation of the second portion of the commission among the one or more individuals is dictated by the one or more individuals.

29. A method for distributing an annotated media stream created by a first user, comprising:

selecting a media stream under instruction from the first user, wherein the media stream is associated with an index of one or more segment identifiers that are associated with one or more segments of the media stream;

selecting at least one item of supplemental content under instruction from the first user;

mapping the at least one item of supplemental content to at least one of the one or more segment identifiers, such that the media stream remains substantially unaltered, wherein the mapping is performed under instruction of the first user to produce a mapping;

distributing the media stream and the mapping to a first display device operated by a second user, different from the first user, wherein the media stream and the mapping produce the annotated media stream when utilized together, wherein the distributing comprises displaying the at least one item of supplemental content and at least a portion of the media stream in a simultaneous, time-synchronized manner such that the at least one item of supplemental content relates to a localized context specific to the segment, wherein the at least one item of supplemental content and a segment of the one or more segments of the media stream indicated by the one or more segment identifiers are displayed in separate, non-overlapping viewing panes;

separating the at least one item of supplemental content from the media stream;

sending the at least one item of supplemental content, independent of the media stream, to a second display device operated by the second user for later viewing without requiring an input from the second user or from the second display device;

collecting a commission when the annotated media stream is viewed by the second user;

providing a first portion of the commission to the first user, wherein an amount of the first portion of the commission is calculated, at least in part, based on a number of times the annotated media stream has been viewed; and

providing a second portion of the commission to one or more individuals who selected the at least one item of supplemental content for mapping, wherein an allocation of the second portion of the commission among the one or more individuals is dictated by the one or more individuals.

30. The method of claim 29, wherein the collecting requires further action on a part of the second user.

31. The method of claim 30, wherein the further action is a selection of a hyperlink contained in the at least one item of supplemental content.

32. The method of claim 30, wherein the further action is a consummation of a commercial transaction.

33. The method of claim 29, further comprising:

providing at least a portion of the commission to a contributor of the at least one item of supplemental content.

34. The method of claim 29, wherein the commission is a monetary commission.

35. The method of claim 29, wherein the commission is in a form of a redeemable coupon or credit.

36. The method of claim 29, wherein the commission is collected from a provider of the at least one item of supplemental content.

37. The method of claim 29, wherein the commission is collected from a seller of an article represented by the at least one item of supplemental content.

38. The method of claim 29, wherein the at least one item of supplemental content relates to an article, a person, or a concept, and the at least one item of supplemental content comprises at least one of:

text, audio, video, a multimedia presentation, a photograph, an image, a uniform resource locator, a computer application, data, commentary, advertising copy, a keyword, a tag, an element that encourages interactive participation by the viewer, variable data, raw data, stylized information, or a placeholder.

39. The method of claim 38, wherein the article, person or concept is depicted in or suggested by the media stream.

40. The method of claim 29, wherein an amount of the commission is dictated by a provider of the commission prior to the second user viewing the annotated media stream.

41. The method of claim 29, wherein the selecting the media stream comprises:

receiving the media stream from the first user over a network.

42. The method of claim 29, wherein the separate, non-overlapping viewing panes are displayed on a common display of a device used by the second user.

43. The method of claim 42, wherein a viewing pane of the separate, non-overlapping viewing panes in which the at least a portion of the media stream is displayed has a frame size that remains substantially consistent throughout a display of the media stream.

44. A non-transitory computer readable medium containing an executable program for distributing an annotated media stream created by a first user, where the program performs steps of:

selecting a media stream under instruction from the first user, wherein the media stream is associated with an index of one or more segment identifiers that are associated with one or more segments of the media stream;

selecting at least one item of supplemental content under instruction from the first user;

mapping the at least one item of supplemental content to at least one of the one or more segment identifiers, such that the media stream remains substantially unaltered, wherein the mapping is performed under instruction of the first user to produce a mapping;

distributing the media stream and the mapping to a first display device operated by a second user, different from the first user, wherein the media stream and the mapping produce the annotated media stream when utilized together, wherein the distributing comprises displaying the at least one item of supplemental content and at least a portion of the media stream in a simultaneous, time-synchronized manner such that the at least one item of supplemental content relates to a localized context specific to the segment, wherein the at least one item of supplemental content and a segment of the one or more segments of the media stream indicated by the one or more segment identifiers are displayed in separate, non-overlapping viewing panes;

separating the at least one item of supplemental content from the media stream; and

sending the at least one item of supplemental content, independent of the media stream, to a second display device operated by the second user for later viewing without requiring an input from the second user or from the second display device;

collecting a commission when the annotated media stream is viewed by the second user;

providing a first portion of the commission to the first user, wherein an amount of the first portion of the commission is calculated, at least in part, based on a number of times the annotated media stream has been viewed; and

providing a second portion of the commission to one or more individuals who selected the at least one item of supplemental content for mapping, wherein an allocation of the second portion of the commission among the one or more individuals is dictated by the one or more individuals.

45. System for distributing an annotated media stream created by a first user, comprising:

a first user device for selecting a media stream and at least one item of supplemental content under instruction from the first user, wherein the media stream is associated with an index of one or more segment identifiers that are associated with one or more segments of the media stream, and wherein the first user device is also for mapping the at least one item of supplemental content to at least one of the one or more segment identifiers, such that the media stream remains substantially unaltered, wherein the mapping is performed under instruction of the first user to produce the annotated media stream; and

a server for distributing the media stream and the mapping to a second user device, different from the first user device, wherein the media stream and the mapping produce the annotated media stream when utilized together, wherein the distributing comprises displaying the at least one item of supplemental content and at least a portion of the media stream in a simultaneous, time-synchronized manner such that the at least one item of supplemental content relates to a localized context specific to the segment, wherein the at least one item of supplemental content and a segment of the one or more segments of the media stream indicated by the one or more segment identifiers are displayed in separate, non-overlapping viewing panes, the server being further configured for separating the at least one item of supplemental content from the media stream and sending the at least one item of supplemental content, independent of the media stream, to a third user device different from the first user device and the second user device without requiring an input from the second user or from the third user device, and wherein the server is also for collecting a commission when the annotated media stream is viewed on the second user device and for providing a first portion of the commission to the first user and a second portion of the commission to one or more individuals who selected the at least one item of supplemental content for mapping, wherein an amount of the first portion of the commission is calculated based at least in part on a number of times the annotated media stream has been viewed, and an allocation of the second portion of the commission among the one or more individuals is dictated by the one or more individuals.