System and method for synchronizing streaming content with enhancing content using pre-announced triggers

• US 8,479,251 B2
• Filed: 09/03/2004
• Issued: 07/02/2013
• Est. Priority Date: 03/31/1999
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Feinleib, David A., Sheldon, Isaac A.
• Primary Examiner(s): Parry, Chris
• Assistant Examiner(s): MARANDI, JAMES R
• Application Number:
  US10/933,623
• Publication Number:
  US 20050028195A1
• Time in Patent Office: 3,224 Days
• Field of Search: 725/32, 725/114, 725/135
• US Class Current: 725/136
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/4886 for displaying a ticker, e.g. scrolling banner for news, stock exchange, weather data
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 7/088 the inserted signal being digital
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

A client-server architecture synchronizes streaming content with enhancing content via pre-announced triggers. The architecture includes server-based components to generate announcements containing information specifying how and when to receive upcoming triggers that will be transmitted at a later time. The server transmits the announcements to a general broadcast or multicast IP address. Client-based components monitor the IP address to receive and filter the announcements. Selected announcements are stored in a guide database in correlation with the streaming content programs to indicate that the programs are interactive. When a user tunes to an interactive program, the client opens a container HTML page that contains controls to receive the streaming content program and to extract the announcements from the guide database. The latter control monitors the IP address at the times specified in the selected announcements to receive the triggers corresponding to the interactive program. The server delivers the triggers at times synchronized to the streaming content. When triggers arrive, the client control processes the triggers to coordinate presentation of the enhancing content with the streaming content program. The triggers may further be used to carry items that fill a ticker being displayed with the program.

Claims

1. A method for synchronizing streaming content with enhancing content, comprising:

receiving, by a computing device, an announcement on a monitored address containing information specifying how and when to receive upcoming enhancing content, the announcements informing a client that the streaming content is interactive, providing details about the corresponding enhancing content, and describing an IP address and port on which corresponding triggers will be sent for a particular enhancement, transmission-related information, and information pertaining to content of the enhancing content;

passing, by the computing device, each announcement through one or more filters to determine whether each announcement is either a match against a list of programs in which a user is interested or is a match against other types of predefined rules of acceptance;

retaining, by the computing device, the announcements of interest and discarding remaining announcements;

receiving, by the computing device, the streaming content which is associated with the enhancing content, the streaming content including;

one or more triggers that notify a client to perform a particular action, each trigger being formatted as a string containing a key or numerical identifier, trigger data, and a checksum value and the one or more triggers containing ticker data associated with the enhanced content; and

one or more data files that are either an interactive content file or contain packages containing the interactive content files;

receiving, by the computing device, the enhancing content according to the information contained in the announcement and at a time in synchronization with the streaming content;

enhancing, by the computing device, the streaming content with the enhancing content; and

presenting the ticker data contained in the one or more triggers within a ticker and displaying the ticker together with the enhancing content and the streaming content.

2. A method as recited in claim 1, wherein the announcement contains parameters selected from a group comprising:

a broadcast locator, a time when the corresponding enhancing content is to be sent, a protocol, an identity of the streaming content that the enhancing content enhances, and a page that contains a starting point for the enhancing content.

3. A method as recited in claim 1,

wherein the data files and the triggers cause operations involving the data files to timely introduce the enhancing content with the streaming content, and

wherein the method further comprises:

receiving the data files; and

receiving the triggers at times in synchronization with the streaming content.

4. A method as recited in claim 3,

wherein the enhancing content further comprises dependency files that contain instructions to present content contained in the data files, and

wherein the method further comprises delivering the data files together with the dependency files in a cabinet (CAB) file format.

5. A method as recited in claim 1, wherein the receiving comprises receiving the streaming content and receiving the enhancing content in a composite stream of one source.

6. A method as recited in claim 1, wherein the receiving comprises:

receiving the streaming content from a first source; and

receiving the enhancing content from a second source different from the first source.

7. A computer-implemented method for synchronizing streaming content with enhancing content, comprising:

forming announcements containing information specifying a first address and a time at which to receive upcoming triggers, the announcements informing a client that the streaming content is interactive, providing details about the corresponding enhancing content, and describing an IP address and port on which the triggers will be sent for a particular enhancement, transmission-related information, and information pertaining to content of the enhancing content, and the triggers notifying the client when the enhancing content can be invoked and notifying the client to perform a particular action, each of the triggers being formatted as a string containing a key or numerical identifier, trigger data, and a checksum value, and the triggers containing ticker data associated with the enhancing content;

sending the announcements by one of broadcast and multicast to a second address;

monitoring the second address to receive the announcements;

passing each announcement through one or more filters to determine whether each announcement is either a match against a list of programs in which a user is interested or is a match against other types of predefined rules of acceptance;

retaining the announcements of interest and discarding remaining announcements;

monitoring the first address at the time specified in the selected announcements to receive the triggers;

processing the triggers to coordinate presentation of the enhancing content with the streaming content, the processing including informing the client to invoke the triggers to access the enhancing content, and the streaming content including one or more data files that are either an interactive content file or contain packages containing the interactive content files; and

presenting the ticker data contained in the triggers within a ticker and displaying the ticker together with the enhancing content and the streaming content.

8. A method as recited in claim 7, wherein the forming comprises creating an announcement to contain parameters selected from a group comprising:

a broadcast locator, a time when a corresponding trigger is to be broadcast, a broadcast protocol, an identity of the streaming content that the enhancing content enhances, and a page that contains a starting point for the enhancing content.

9. A method as recited in claim 7, wherein the processing comprises receiving the enhancing content according to a predetermined protocol and storing the enhancing content.

10. A method as recited in claim 7, wherein the processing comprises navigating within a container HTML page.

11. A method as recited in claim 7, wherein the processing comprises invoking a script within a container HTML page.

12. A method as recited in claim 7, further comprising sending the enhancing content together with the triggers.

13. A method as recited in claim 7, further comprising delivering the streaming content, the enhancing content, and the triggers from a same source.

14. A method as recited in claim 7, further comprising:

delivering the enhancing content from a first source; and

delivering the streaming content and the triggers from a second source different from the first source.

15. A method as recited in claim 7, further comprising displaying the enhancing content together with the streaming content.

16. A method, comprising:

displaying, by a computing device, streaming content;

monitoring, by the computing device, an announcement address to receive announcements pertaining to enhancing content for enhancing the streaming content, the announcements containing information that specify a trigger address and times at which to receive upcoming triggers, the announcements further informing a client that the streaming content is interactive, providing details about the corresponding enhancing content, and describing an IP address and port on which corresponding triggers will be sent for a particular enhancement, transmission-related information, and information pertaining to content of the enhancing content, and the triggers notifying the client when the enhancing content can be invoked and notifying the client to perform a particular action, each of the triggers being formatted as a string containing a key or numerical identifier, trigger data, and a checksum value and the triggers containing ticker data associated with the enhancing content;

passing, by the computing device, each announcement through one or more filters to determine whether each announcement is either a match against a list of programs in which a user is interested or is a match against other types of predefined rules of acceptance to retain selected announcements;

retaining, by the computing device, the selected announcements and discarding remaining announcements;

storing, by the computing device, the selected announcements;

monitoring, by the computing device, the trigger address at the times specified in the selected announcements to receive corresponding triggers;

processing, by the computing device, the triggers to cause one of the following events to occur;

(1) receive one or more data files having the enhancing content, or (2) utilize the enhancing content in the data files to enhance the streaming content, the processing including informing the client to invoke the triggers to access the enhancing content, and the enhancing content including one or more data files that are either an interactive content file or contain packages containing the interactive content files; and

presenting the ticker data contained in the triggers within a ticker and displaying the ticker together with the enhancing content and the streaming content.

17. A method as recited in claim 16, further comprising caching the data files.

18. A method as recited in claim 16, further comprising presenting the streaming content and the enhancing content using an HTML page.

19. A method as recited in claim 16, further comprising:

using information from the trigger to invoke a script; and

executing the script to enhance the streaming content.

20. A method, comprising:

monitoring, by a computing device, an IP (Internet Protocol) address to receive triggers in synchronization with a streaming content, wherein enhancing content is associated with the streaming content, the triggers informing a client to invoke the enhancing content and notifying the client to perform a particular action, each of the triggers being formatted as a string containing a key or numerical identifier, trigger data, and a checksum value and the triggers containing ticker data associated with the enhancing content;

receiving, by the computing device, an announcement on a monitored address containing information specifying how and when to receive upcoming enhancing content and describing an IP address and port on which the triggers will be sent for a particular enhancement, transmission-related information, and information pertaining to content of the enhancing content, wherein the enhancing content includes one or more data files that are either an interactive content file or contain packages containing the interactive content files;

passing, by the computing device, each announcement through one or more filters to determine whether each announcement is either a match against a list of programs in which a user is interested or is a match against other types of predefined rules of acceptance;

retaining, by the computing device, the announcements of interest and discarding remaining announcements;

forming, by the computing device, an array of the ticker data received in the triggers; and

displaying, by the computing device, the array of the items within the ticker together with the enhancing content and the streaming content.

21. A method as recited in claim 20, further comprising receiving announcements at another IP address, the announcements being used to announce upcoming transmissions of the triggers.

22. A method comprising:

monitoring, by a computing device, an announcement address to receive announcements pertaining to enhancing content for enhancing the streaming content, the announcements containing information that specify a trigger address and a time at which to receive upcoming triggers, the announcements are further to inform a client that the streaming content is interactive, to provide details about the corresponding enhancing content, and to describe an IP address and port on which the triggers will be sent for a particular enhancement, transmission-related information, and information pertaining to content of the enhancing content, and the triggers are to notify the client to perform a particular action, each of the triggers being formatted as a string containing a key or numerical identifier, trigger data, and a checksum value and the triggers containing ticker data associated with the enhancing content;

passing, by the computing device, each announcement through one or more filters to determine whether each announcement is either a match against a list of programs in which a user is interested or is a match against other types of predefined rules of acceptance to retain selected announcements;

retaining, by the computing device, the selected announcements and discarding remaining announcements;

monitoring, by the computing device, the trigger IP address at the time specified in one of the selected announcements to receive a corresponding trigger;

processing, by the computing device, the trigger to cause utilization of the enhancing content to enhance the streaming content, to process the trigger is further to inform the client to invoke the trigger to access the enhancing content, wherein the enhancing content includes one or more data files that are either an interactive content file or contain packages containing the interactive content files; and

presenting the ticker data contained in the triggers within a ticker and display the ticker together with the enhancing content and the streaming content.

23. A system comprising:

memory;

one or more processors;

one or more modules stored in the memory and executable by the one or more processors to;

monitor an IP address to receive enhancing content, wherein the enhancing content is received according to instructions contained in an announcement, and wherein the enhancing content comprises triggers, each trigger containing at least one item, the announcements are further to inform a client that the streaming content is interactive, to provide details about the corresponding enhancing content, and to describe an IP address and port on which the triggers will be sent for a particular enhancement, transmission-related information, and information pertaining to content of the enhancing content, and the triggers are to notify the client when the enhancing content can be invoked and to notify the client to perform a particular action, each of the triggers being formatted as a string containing a key or numerical identifier, trigger data, and a checksum value and the triggers containing ticker data associated with the enhancing data, wherein the enhancing content includes one or more data files that are either an interactive content file or contain packages containing the interactive content files;

present a ticker that contains the ticker data together with the enhancing content and the streaming content;

pass each announcement through one or more filters to determine whether each announcement is either a match against a list of programs in which a user is interested or is a match against other types of predefined rules of acceptance; and

retain the announcements of interest and discard remaining announcements.

24. A system for synchronizing streaming content with enhancing content, comprising:

at least one content server;

a client;

the content server being configured to form announcements that contain information specifying an IP address and a time at which to receive upcoming triggers, the content server sending the announcements by at least one of broadcasting and multicasting to the client, the announcements are further to inform the client that the streaming content is interactive, to provide details about the corresponding enhancing content, and to describe an IP address and port on which the triggers will be sent for a particular enhancement, transmission-related information, and information pertaining to content of the enhancing content; and

the client being configured to receive the announcements and monitor the IP address at the time specified in the announcements to receive the triggers, the client processing the triggers to coordinate presentation of the enhancing content with the streaming content, the processing is further to inform the client to invoke the trigger to access the enhancing content, each of the triggers being formatted as a string containing a key or numerical identifier, trigger data, and a checksum value and the triggers containing ticker data associated with the enhancing content, and the enhancing content including one or more data files that are either an interactive content file or contain packages containing the interactive content files,

wherein the client is further configured to;

pass each announcement through one or more filters to determine whether each announcement is either a match against a list of programs in which a user is interested or is a match against other types of predefined rules of acceptance;

retain the announcements of interest and discard remaining announcements; and

present the ticker data contained in the triggers within a ticker and display the ticker together with the enhancing content and the streaming content.

25. A system as recited in claim 24, wherein the announcements contain parameters selected from a group comprising:

a broadcast locator, a time when a corresponding trigger is to be broadcast, a broadcast protocol, an identity of the streaming content that the enhancing content enhances, and a page that contains a starting point for the enhancing content.

26. A system as recited in claim 24, wherein the client receives the enhancing content according to a predetermined protocol and caches the enhancing content.

27. A system as recited in claim 24, wherein the client uses information from the trigger to navigate within a container HTML page.

28. A system as recited in claim 24, wherein the client uses information from the trigger to invoke a script within a container HTML page.

29. A system as recited in claim 24, wherein the content server delivers the streaming content, the enhancing content, and the triggers.

30. A system as recited in claim 24, wherein the content server delivers the enhancing content and the triggers, and further comprising a second content server to deliver the streaming content.

31. A client architecture, comprising:

a video control of a computing device to play video content on a display device;

a listener of the computing device to monitor an announcement IP (Internet Protocol) address to receive, from a server, announcements pertaining to enhancing content for enhancing the video content, the announcements containing information that specify a trigger IP address and times at which to receive upcoming triggers, the announcements are further to inform the listener that the video content is interactive, to provide details about the corresponding enhancing content, and to describe an IP address and port on which the triggers will be sent for a particular enhancement, transmission-related information, and information pertaining to content of the enhancing content, and the enhancing content includes one or more data files that are either an interactive content file or contain packages containing the interactive content files;

the listener further monitoring the trigger IP address at the times specified by the announcements to receive corresponding triggers; and

a rendering component of the computing device to present the video content on the display device and to enhance the video content with the enhancing content according to instructions received in the triggers, the triggers are further to inform the listener to invoke the triggers to access the enhancing content, each of the triggers being formatted as a string containing a key or numerical identifier, trigger data, and a checksum value and the triggers containing ticker data associated with the enhancing content, the rendering component further configured to present the ticker data in a ticker and display the ticker together with the enhancing content and the streaming content,

wherein each announcement is passed through one or more filters to determine whether each announcement is either a match against a list of programs in which a user is interested or is a match against other types of predefined rules of acceptance, retaining the announcements of interest and discarding the remaining announcements.

32. A client architecture as recited in claim 31, further comprising a storage to hold the announcements in correlation with an identity of the video content.

33. A client architecture as recited in claim 31, further comprising a cache to hold the enhancing content.

34. A client architecture as recited in claim 31, wherein the listener and video control are contained within an HTML page rendered by the rendering component.

35. A client architecture as recited in claim 34, wherein the HTML page also has one or more scripts to process the instructions contained in the triggers.