Method for the real-time distribution of streaming data on a network

• US 7,305,483 B2
• Filed: 04/25/2002
• Issued: 12/04/2007
• Est. Priority Date: 04/25/2002
• Status: Expired due to Term

• Current Assignee: Yahoo Assets LLC
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Kekre, Amol, Bennett, Michael, Yao, Hongyu
• Primary Examiner(s): Najjar; Saleh
• Assistant Examiner(s): LAZARO, DAVID R
• Application Number:
  US10/132,974
• Publication Number:
  US 20030204585A1
• Time in Patent Office: 2,049 Days
• Field of Search: 709/203, 709/219, 709/232, 709/101, 709/224, 709/231, 709/207, 707/203, 707/207, 707/231
• US Class Current: 709/231
• CPC Class Codes: H04L 12/1895 for short real-time information, e.g. alarms, notifications, alerts, updates
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 21/238 Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/23805 Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/26291 for providing content or additional data updates, e.g. updating software modules, stored at the client deployment, distribution, installation, update of software G06F8/65; error detection or correction during software upgrading G06F11/1433; arrangements for updating broadcast information or broadcast-related information H04H60/25
• CPC Class Codes: H04N 21/4886 for displaying a ticker, e.g. scrolling banner for news, stock exchange, weather data
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts

Abstract

A method for sampling of streaming data for distribution on a network (e.g., the Internet) includes receiving the streaming data (which includes periodically updated information items) from a streaming data source. The periodically updated information items of the streaming data are subsequently sampled using a sampling process based on a total update rate of the streaming data (U_a) and a capacity of the network (C), thereby creating a sampled data stream. Alternatively, the periodically updated information items of the streaming data can be sampled using a sampling process that is also based on the importance (K_qmin) of each of the periodically updated information items and the update rate (U_q) of each of the periodically updated information items to create the sampled data stream. The sampled data stream is then distributed on the network (e.g., the Internet or a private area network).

Claims

1. A method for sampling streaming data, which includes periodically updated information items, for real-time distribution on a network, the method comprising:

receiving the streaming data from a streaming data source;

sampling the periodically-updated information items of the streaming data using a sampling process based at least in part on one or more update rates of the information items of the streaming data and on a capacity of the network into which the data is to be distributed, thereby creating a sampled data stream;

distributing the sampled data stream on the network;

determining, over a sweep interval, if any of the periodically-updated information items were updated by the streaming data but not sampled in the sampling step and distributed in the distributing step; and

distributing on the network the information items determined in the step of determining, independent of the sampling process that would have otherwise excluded the distribution of the information item for the sweep interval.

2. The method of claim 1, wherein the one or more update rates and network capacity are dynamically determined.

3. The method of claim 1, wherein the sampling is further based on a determined importance of each of the periodically-updated information items.

4. The method of claim 3, wherein the one or more update rates comprises an update rate of each of the periodically-updated information items.

5. The method of claim 1, wherein the one or more update rates comprises a dynamically-determined update rate of each of the periodically-updated information items and a dynamically-determined total update rate of the information items in the streaming data, wherein the network capacity comprises a dynamically-determined network capacity, and wherein the sampling is further based on a determined importance of each of the periodically-updated information items.

6. The method of claim 5, wherein the dynamically-determined total update rate, the dynamically-determined network capacity and the dynamically-determined update rate of each of the periodically-updated information items are dynamically determined at least every predetermined time interval.

7. The method of claim 3 or 5, wherein the determined importance is dynamically determined at least every predetermined time interval.

8. The method of claim 7, wherein the determined importance is dynamically determined based on execution conditions.

9. The method of claim 7, wherein the determined importance is dynamically determined based on a previously-determined importance, the current network capacity, and a previous network capacity.

10. The method of claim 1, wherein the streaming data includes periodically-updated financial quote information items.

11. The method of claim 1, wherein the streaming data includes periodically-updated financial quote information items.

13. The method of claim 10, wherein the streaming data includes periodically-updated financial quote information items.

14. The method of claim 10, wherein the total update rate, the network capacity and the dynamically-determined update rate of each of the periodically-updated information items are dynamically-determined at least every predetermined time interval.

15. The method of claim 10, wherein the determined importance (Kqmii) of each of the periodically-updated information items is dynamically determined based on execution conditions.

16. The method of claim 10, wherein the determined importance (Kqmiti) of each of the periodically-updated information items is dynamically determined based on a previously-determined importance, the current network capacity, and a previous network capacity.

12. A method for sampling streaming data, which includes periodically-updated information items, for distribution on a network, the method comprising:

receiving the streaming data from a streaming data source;

sampling each of the periodically-updated information items of the streaming data so as to create a sampled data stream using a sampling process based on;

a dynamically-determined total update rate of the streaming data (U_a);

a dynamically-determined capacity of the network (C);

a determined importance (K_qmin) of each of the periodically-updated information items; and

a dynamically-determined update rate (U_q) of each of the periodically-updated information items;

distributing the sampled data stream on the network;

determining, over a sweep interval, if any of the periodically-updated information items were updated by the streaming data but not sampled and distributed; and

distributing on the network the information items determined in the step of determining, independent of the sampling process that would have otherwise excluded the distribution of the information item for the sweep interval.