Methods and apparatus for providing content and services coordinated with television content

• US 20070022437A1
• Filed: 07/14/2006
• Published: 01/25/2007
• Est. Priority Date: 07/19/2005
• Status: Abandoned Application

• Current Assignee: ETV Corporation
• Original Assignee: ETV Corporation
• Inventors: Gerken, David
• Application Number:
  US11/486,982
• Publication Number:
  US 20070022437A1
• Time in Patent Office: Days
• US Class Current: 725/41
• CPC Class Codes: H04H 60/76 Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet for broadcast H04H20/65
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Methods and apparatus for providing content and services to an Internet-enabled device in synchronization with media content presented on a television, radio or other separate device are described. In various embodiments, information suitable for identifying the media content being presented on a television or radio is detected by an audio or video receiver such as a microphone, video camera or optical receiver built into or connected to a PC or laptop. Corresponding content is then fetched from Internet servers or local memory or storage and displayed on the PC or laptop. Also, a program module-based framework that provides for the delivery of such media-coordinated content across multiple programs and advertisements and multiple content providers is described.

Claims

1. A method of providing at least some additional content in conjunction with an ongoing media presentation, the method comprising:

monitoring at least one of an audio and a visual output of said ongoing presentation to detect information suitable for identifying the content being presented; and

retrieving at least one of an event sequence module, additional content and an application using content identifying information detected by said monitoring, said event sequence module including at least one element used for controlling retrieval or presentation of additional content.

2. The method of claim 1, wherein said step of retrieving at least one of an event sequence module, additional content and an application includes:

downloading at least one of an event sequence module, additional content and an application corresponding to said media presentation from a remote server.

3. The method of claim 2, wherein said downloading is performed via an Internet connection.

4. The method of claim 1, wherein said step of retrieving at least one of an event sequence module, additional content and an application includes:

accessing a local storage device to retrieve at least one of an event sequence module, additional content and an application corresponding to said media presentation.

5. The method of claim 2, wherein downloading at least one of an event sequence module, additional content and an application corresponding to said media presentation includes:

communicating content identifying information to said remote server; and

receiving from said server at least one of an event sequence module, additional content and an application corresponding to said media presentation.

6. The method of claim 5, further comprising:

accessing stored profile information corresponding to the content consumer and communicating said profile information to said remote server; and

receiving from said server at least one of an event sequence module, additional content and an application corresponding to both at least some accessed profile information and the identity of the identified media presentation.

7. The method of claim 5, further comprising:

presenting said additional content, additional content retrieved according to said event sequence module, or additional content generated by executing said application corresponding to said media presentation to an observer of said ongoing media presentation.

8. The method of claim 7, wherein said presenting of said additional content is on a consumer device which is separate from a first output device which output the monitored at least one of said audio and visual output.

9. The method of claim 7, wherein said additional content is presented at a time which is coordinated with a portion of said media presentation.

10. The method of claim 1, wherein said media presentation is audio content.

11. The method of claim 1, wherein said media presentation is video content.

12. The method of claim 1, wherein said additional content is retrieved according to at least one element of said event sequence module.

13. The method of claim 12, wherein said additional content is retrieved substantially in advance of its intended presentation time as designated by said event sequence module.

14. The method of claim 1, wherein the detected information suitable for identifying the content being presented is not perceivable to an unaided human observer of said at least one of an audio and a visual output.

15. An apparatus for providing at least some additional content in conjunction with an ongoing media presentation, the apparatus comprising:

at least one of an audio and image sensor for detecting at least one of an audio and video output of said ongoing media presentation;

a detection module for receiving an output from said at least one audio and image sensor and for identifying from the sensor output information suitable for identifying the content being presented; and

a retrieval module for retrieving at least one of an event sequence module, additional content and an application using content identifying information obtained from said detection module, said event sequence module including at least one element used for controlling retrieval or presentation of additional content.

16. The apparatus of claim 15, wherein said retrieval module includes an interface used for downloading at least one of an event sequence module, additional content and an application corresponding to said media presentation from a remote server.

17. The apparatus of claim 16, wherein said interface is an Internet connection.

18. The apparatus of claim 15, further including:

a local storage device accessible to said retrieval module for locally storing at least one of an event sequence module, additional content and an application corresponding to said media presentation.

19. The apparatus of claim 16, further comprising:

a transmission module for communicating content identifying information to said remote server; and

a receiver module for receiving from said remote server at least one of an event sequence module, additional content and an application corresponding to said media presentation.

20. The apparatus of claim 19, further comprising:

memory including stored profile information corresponding to the content consumer which can be accessed by said retrieval module and communicated to said remote server.

21. The apparatus of claim 19, further comprising:

a separate output device which is in addition to the output device used to output said media presentation, for presenting said additional content, additional content retrieved according to said event sequence module, or additional content generated by executing said application corresponding to said media presentation to an observer of said ongoing media presentation.

22. The apparatus of claim 21, wherein said separate output device is a display device which is separate from a first display device used to output said media presentation.

23. The apparatus of claim 21, further comprising:

a processor for controlling presentation of said additional content under control of said event sequence module or said application corresponding to said media presentation to provide said additional content in coordination with a portion of said media presentation.

24. The apparatus of claim 15, wherein said media presentation is audio content.

25. The apparatus of claim 15, wherein said media presentation is video content.

26. A method of operating a network device, the method comprising:

receiving information suitable for identifying a media presentation from a consumer device monitoring at least one of an audio and a visual output of a first presentation device presenting said media presentation;

in response to said content identifying information, retrieving an event sequence module corresponding to the identified media presentation; and

communicating said event sequence module to said consumer device, said event sequence module including at least one element used for controlling retrieval or presentation of additional content to said consumer device.

27. The method of claim 26, wherein said event sequence module further includes synchronization information used for controlling delivery of additional content to said consumer device in synchronization with said identified media presentation.

28. The method of claim 26, wherein said first presentation device is a television set and said consumer device is a computer-based device.

29. The method of claim 27, wherein said synchronization information includes time information indicating a first point in time during said identified media presentation at which additional content indicated by said event sequence module is to be presented.

30. The method of claim 29, wherein said event sequence module includes additional time information indicating an additional point in time during said identified media presentation at which further additional content indicated by said event sequence module is to be presented.

31. The method of claim 30, wherein said indicated first point in time and said additional point in time are indicated by a value relative to the start of the media presentation.

32. The method of claim 30, wherein said event sequence module includes information indicating a location from which said additional content can be retrieved.

33. The method of claim 30, wherein said event sequence module includes at least some of said additional content.

34. The method of claim 26, wherein said event sequence module includes a plurality of presentation times and corresponding actions, at least some actions corresponding to different presentation times and having different URLs associated with them.

35. The method of claim 34, wherein said different presentations times are referenced relative to the start of said identified media presentation.

36. The method of claim 30, wherein said event sequence module includes content to be presented at a point relative to a detected presented portion of said media presentation.

37. The method of claim 36, wherein times indicated in said event sequence module are expressed relative to the start of said media presentation and have a predetermined time relationship to points within the media presentation which may be detected.

38. The method of claim 26, further comprising:

receiving or accessing stored profile information corresponding to said content consumer; and

wherein said step of retrieving said event sequence module includes selecting an event sequence module from a library of event sequence modules as a function of both at least some received or accessed user profile information and the identity of the identified media presentation.

39. The method of claim 26, further comprising:

receiving or accessing stored profile information corresponding to said content consumer; and

wherein said step of retrieving said event sequence module includes generating an event sequence module as a function of both at least some received or accessed user profile information and the identity of the identified media presentation.

40. The method of claim 39, wherein said content identifying information includes information sufficient to determined at least one of the content and distribution source of said media presentation.

41. The method of claim 40, wherein said content identifying information includes information sufficient to determine both the content and distribution source of the media presentation.

42. The method of claim 39, wherein said content identifying information includes information sufficient to determine both the distribution source and the actual time at which said distribution source broadcast said content.

43. The method of claim 26, further comprising:

wherein said step of retrieving said event sequence module includes selecting an event sequence module from a library of event sequence modules as a function of both the actual time of said media presentation and the identity of the identified media presentation.

44. The method of claim 26, further comprising:

transmitting, for use subsequent to the identified media presentation, at least one of an additional event sequence module and additional content corresponding to said additional event sequence module to a consumer device based on a probability that a media presentation corresponding to said additional event sequence module will be presented in temporal proximity to said identified media presentation.

45. A network device, comprising:

a receiver module for receiving, from a consumer device monitoring at least one of an audio and a visual output of a first presentation device, information suitable for identifying a media presentation;

a retrieval module for retrieving at least one event sequence module corresponding to said media presentation; and

a transmission module for communicating an event sequence module to said consumer device that was retrieved by said retrieval module, said event sequence module including at least one element used for controlling retrieval or presentation of additional content to said consumer device.

46. The network device of claim 45, further comprising:

a storage device, accessible to said retrieval module, said storage device including said event sequence module, said even sequence module further including stored synchronization information used for controlling delivery of additional content to said consumer device in synchronization with said identified media presentation.

47. The network device of claim 46, wherein said stored synchronization information includes time information indicating a first point in time during said identified media presentation at which additional content indicated by said event sequence module is to be presented.

48. The network device of claim 47, wherein said event sequence module included in said storage device further includes additional time information indicating an additional point in time during said identified media presentation at which further additional content indicated by said event sequence module is to be presented.

49. The network device of claim 48, wherein said indicated first point in time and said additional point in time are indicated by a value relative to the start of the media presentation.

50. The network device of claim 48, wherein said stored event sequence module includes information indicating a location from which said additional content can be retrieved.

51. The network device of claim 48, wherein said stored event sequence module includes at least some of said additional content.

52. The network device of claim 45, wherein stored said event sequence module includes a plurality of presentation times and corresponding actions, at least some actions corresponding to different presentation times and having different URLs associated with them.

53. The network device of claim 52, wherein said different presentations times are referenced relative to the start of said identified media presentation.

54. The network device of claim 45, further comprising:

stored profile information corresponding to said content consumer; and

wherein said retrieval module includes an event sequence module selection module for selecting an event sequence module from a library of event sequence modules as a function of both at least some received or accessed user profile information and the identity of the identified media presentation.

55. The network device of claim 45, further comprising:

stored profile information corresponding to said content consumer; and

wherein said retrieval module includes an event sequence module generation module for generating an event sequence module as a function of both at least some received or accessed user profile information and the identity of the identified media presentation.

56. The network device of claim 45, further comprising:

an additional event sequence module selection module for selecting an additional event sequence module based on a probability that a media presentation corresponding to said additional event sequence module will be presented in temporal proximity to said identified media presentation.

57. The network device of claim 56, further comprising:

a preloading module for downloading at least one of an additional event sequence module selected by said additional event sequence module selection module and additional content, said additional content corresponding to said additional event sequence module, to said consumer device.