Method for the real-time distribution of streaming data on a network

• US 20030204585A1
• Filed: 04/25/2002
• Published: 10/30/2003
• Est. Priority Date: 04/25/2002
• Status: Active Grant

• Current Assignee: Yahoo Assets LLC
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Kekre, Amol, Bennett, Michael, Yao, Hongyu
• Granted Patent: US 7,305,483 B2
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: H04L 12/1895 for short real-time information, e.g. alarms, notifications, alerts, updates
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 21/238 Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/23805 Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/26291 for providing content or additional data updates, e.g. updating software modules, stored at the client deployment, distribution, installation, update of software G06F8/65; error detection or correction during software upgrading G06F11/1433; arrangements for updating broadcast information or broadcast-related information H04H60/25
• CPC Class Codes: H04N 21/4886 for displaying a ticker, e.g. scrolling banner for news, stock exchange, weather data
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts

Abstract

A method for sampling of streaming data for distribution on a network (e.g., the Internet) includes receiving the streaming data (which includes periodically updated information items) from a streaming data source. The periodically updated information items of the streaming data are subsequently sampled using a sampling process based on a total update rate of the streaming data (U_a) and a capacity of the network (C), thereby creating a sampled data stream. Alternatively, the periodically updated information items of the streaming data can be sampled using a sampling process that is also based on the importance (K_qmin) of each of the periodically updated information items and the update rate (U_q) of each of the periodically updated information items to create the sampled data stream. The sampled data stream is then distributed on the network (e.g., the Internet or a private area network).

Claims

1. A method for sampling streaming data, which includes periodically updated information items, for real-time distribution on a network comprising:

receiving the streaming data from a streaming data source;

sampling the periodically updated information items of the streaming data using a sampling process based on update rates of the information items of the streaming data and a capacity of the network into which the data is to be distributed, thereby creating a sampled data stream; and

distributing the sampled data stream on the network.

2. The method of claim 1 further comprising, during the sampling step, sampling the periodically updated information items of the streaming data using a sampling process based on a dynamically-determined update rates of the streaming data and a dynamically-determined capacity of the network.

3. The method of claim 1, wherein the sampling step samples each of the periodically updated information items of the streaming data using a sampling process that is also based on a predetermined importance of each of the periodically updated information items to create the sampled data stream.

4. The method of claim 3, wherein the sampling step samples each of the periodically updated information items of the streaming data using a sampling process that is also based on an update rate of each of the periodically updated information items to create the sampled data stream.

5. The method of claim 1, further comprising using, during the sampling step, a sampling process that is also based on a dynamically determined total update rate of the information items in the streaming data, a dynamically determined capacity of the network, a predetermined importance of each of the periodically updated information items and a dynamically determined update rate of each of the periodically updated information items.

6. The method of claim 5, where in the dynamically determined total update rate, the dynamically determined capacity and the dynamically determined update rate of each of the periodically updated information items are dynamically determined at least every predetermined time interval.

7. The method of claim 1, further including:

dispersing, following the distributing step, selected periodically updated information items on the network.

8. The method of claim 1, further comprising, during the distributing step, distributing the sampled data stream over a private network.

9. The method of claim 1, further comprising, during the distributing step, distributing the sampled data stream over a network.

10. The method of claim 1, further comprising, during the distributing step, distributing the sampled data stream over a public network.

11. The method of claim 1, wherein the streaming data includes periodically updated financial quote information items.

12. A method for sampling streaming data, which includes periodically updated information items, for distribution on a network:

receiving the streaming data from a streaming data source;

sampling each of the periodically updated information items of the streaming data using a sampling process based on;

1) a dynamically determined total update rate of the streaming data (U_a);

2) a dynamically determined capacity of the network (C);

3) a predetermined importance (K_qmin) of each of the periodically updated information items; and

4) a dynamically determined update rate (U_q) of each of the periodically updated information items, thereby creating a sampled data stream;

distributing the sampled data stream on the network; and

dispersing selected periodically updated information items on the network.

13. The method of claim 12, wherein the streaming data includes periodically updated financial quote information items.

14. The method of claim 12, wherein the total update rate, the capacity and the dynamically determined update rate of each of the periodically updated information items are dynamically determined at least every predetermined time interval.

15. The method of claim 12, wherein the predetermined importance (K_qmin) of each of the periodically updated information items are dynamically determined based on execution conditions.

16. The method of claim 12, further comprising, during the distributing step, distributing the sampled data stream over a private network.

17. The method of claim 12, further comprising, during the distributing step, distributing the sampled data stream over a network.

18. The method of claim 12, further comprising, during the distributing step, distributing the sampled data stream over a public network.

19. The method of claim 12, wherein the streaming data includes periodically updated financial quote information items.

20. A method for sampling streaming data, which includes periodically updated information items, for real-time distribution on a network comprising:

receiving the streaming data from a streaming data source;

sampling the periodically updated information items of the streaming data using a sampling process based on update rates of the information items of the streaming data and a capacity of the network into which the data is to be distributed, thereby creating a sampled data stream;

distributing the sampled data stream on the network;

determining if any of the periodically updated information items were updated by the streaming data but not sampled in the sampling step and distributed in the distributing step over a sweep interval; and

distributing the information items determined in the step of determining on the network, independent of at least one sampling process that would have otherwise excluded the distribution of the information item for the sweep interval.