Opportunistic block transmission with time constraints

• US 8,527,706 B2
• Filed: 09/16/2011
• Issued: 09/03/2013
• Est. Priority Date: 03/23/2005
• Status: Active Grant

• Current Assignee: Numecent Holdings Incorporated
• Original Assignee: Numecent Holdings Incorporated
• Inventors: de Vries, Jeffrey, Hitomi, Arthur Shingen
• Primary Examiner(s): DOAN, DUC T
• Application Number:
  US13/234,950
• Publication Number:
  US 20120096224A1
• Time in Patent Office: 718 Days
• Field of Search: None
• US Class Current: 711/118
• CPC Class Codes: G06F 12/0802 Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
• CPC Class Codes: G06F 12/0862 with prefetch
• CPC Class Codes: G06F 12/0864 using pseudo-associative means, e.g. set-associative or hashing
• CPC Class Codes: G06F 13/1673 using buffers
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 67/5681 Pre-fetching or pre-delivering data based on network characteristics

Abstract

A technique for determining a data window size allows a set of predicted blocks to be transmitted along with requested blocks. A stream enabled application executing in a virtual execution environment may use the blocks when needed.

Claims

1. A system comprising:

a virtual execution environment;

a block granularity caching engine;

a cache;

wherein, in operation;

a process associated with a stream-enabled application is executed in the virtual execution environment;

the virtual execution environment intercepts a request for a resource from the process executing in the virtual execution environment;

the virtual execution environment identifies one or more blocks that are associated with the resource;

the virtual execution environment makes a block request associated with the resource;

the block granularity engine checks the cache for blocks to satisfy the block request;

the block granularity caching engine provides at least one predictively streamed block to the virtual execution environment if the predictively streamed block is found in the cache, the predictively streamed block included as part of an output buffer having a buffer length dependent on a data window size based on an interactivity threshold of the stream-enabled application, the interactivity threshold being an amount of time that a user is willing to wait for the virtual execution environment to access the resource and based on an average user response that is determined by executing the process in the virtual execution environment multiple times, receiving a plurality of user responses to the execution process and averaging the plurality of user responses to create the average user response;

the virtual execution environment satisfies the resource request of the process using the at least one predictively streamed block.

2. The system of claim 1 further comprising:

an interface, wherein, in operation;

the requested block has not been predictively streamed and stored in the cache;

the interface sends the block request to a streaming system.

3. The system of claim 1 further comprising:

an interface, wherein, in operation;

the interface receives the predictively streamed block from a streaming system.

4. The system of claim 1 further comprising:

a predictive block aggregation engine;

wherein, in operation, the predictive block aggregation engine aggregates the predictively streamed blocks with other blocks and provides the predictively streamed blocks prior to the block request.

5. The system of claim 1 further comprising:

a stream enabler that breaks deliverables into blocks of an optimal block size;

wherein, in operation, the optimal block size facilitates providing the requested block within an interactivity threshold.

6. The system of claim 1 further comprising:

a network data engine;

a stream enabler;

a streaming server;

a network coupling the streaming server to the block granularity caching engine;

wherein, in operation;

the stream enabler breaks an application into blocks of an optimal size;

the network data engine provides information useful for determining a data window using throughput and a latency of the network;

the streaming server aggregates the requested and predicted blocks into the output buffer wherein the predicted blocks include the predictively streamed block.

7. The system of claim 1 wherein the interactivity threshold is a default value.

8. The system of claim 1 wherein interactivity threshold is determined through trial and error.

9. A method comprising:

executing a process associated with a stream-enabled application that provides a first request for resources;

receiving, within a data window, one or more blocks including resources used to satisfy the first request for resources as well as one or more predictively streamed blocks, the one or more predictively streamed blocks included as part of an output buffer having a buffer length dependent on a data window size based on an interactivity threshold of the stream-enabled application, the interactivity threshold being an amount of time that a user is willing to wait for the virtual execution environment to access the resource;

executing the process in the virtual execution environment multiple times;

receiving a plurality of user responses to the execution of the process;

averaging the plurality of user responses to create an average user response;

determining the interactivity threshold based on the average user response,

storing one or more predictively streamed blocks in a cache;

providing a second request for resources;

checking the cache to find the one or more predictively streamed blocks to satisfy the second request for resources;

at least partially satisfying the second request for resources using the one or more predictively streamed blocks in the cache.

10. The method of claim 9 further comprising transmitting network information useful for determining a network latency or throughput used in determining a data window size.

11. The method of claim 9 further comprising receiving the predictively streamed blocks in an amount of time that is less than or equal to the interactivity threshold.

12. The method of claim 9 wherein the interactivity threshold is a default value.

13. The method of claim 9 wherein the interactivity threshold is determined through trial and error.

14. A method comprising:

predicting one or more blocks that are associated with resources that will be requested by a stream-enabled application;

adding predicted blocks to an output buffer in order of priority until the output buffer has reached a data window size, the data window size based on an interactivity threshold of the stream-enabled application, the interactivity threshold being an amount of time that a user is willing to wait for the virtual execution environment to access the resource and based on an average user response that is determined by executing the process in the virtual execution environment multiple times, receiving a plurality of user responses to the execution process and averaging the plurality of user responses to create the average user response;

transmitting the blocks in the output buffer.

15. The method of claim 14 further comprising continuously calculating the data window size by continuously recalculating latency and throughput.

16. The method of claim 14 further comprising determining the data window size using the interactivity threshold, a network latency, and a network throughput.

17. The method of claim 14 further comprising continuously updating the data window size using a continuously updated value for latency averaged over two or more time points.

18. The method of claim 14 further comprising continuously recalculating the data window size by regularly recalculating latency by pinging a streaming playback device.

19. The method of claim 14 further comprising reducing the data window size to account for an increase in latency found by pinging a streaming playback device.

20. A system comprising:

a streaming playback device;

a streaming server;

wherein, in operation, the streaming server;

predicts one or more blocks that will be needed by the streaming playback device up to a limit of a data window size set in accordance with an interactivity threshold of a stream-enabled application on the streaming playback device, the interactivity threshold being an amount of time that a user is willing to wait for the virtual execution environment to access the resource and adapted to limit an amount of time for transmission of blocks to preserve a quality of execution of the stream-enabled application, the interactivity threshold based on an average user response that is determined by executing the process in the virtual execution environment multiple times, receiving a plurality of user responses to the execution process and averaging the plurality of user responses to create the average user response;

arranges the one or more blocks into a predictive output buffer;

transmits the predictive output buffer to the streaming playback device for storage in a cache of the streaming playback device.

21. The system of claim 20 wherein blocks are streamed based on priority and block priority is adjusted continuously based on blocks requested.

22. The system of claim 20 wherein the streaming playback device receives predictively streamed blocks of the stream-enabled application in addition to requested blocks.

23. The system of claim 20 wherein the streaming server includes a data window engine, and the data window engine sets the data window size based on the interactivity threshold, a network latency, and a network throughput.

24. The system of claim 20 wherein the streaming playback device includes a stream-enabled application executing in a virtual environment, and the stream-enabled application requests a resource that is satisfied from a predictively streamed block stored in the cache.

25. The system of claim 20 wherein the streaming playback device includes a resource requesting engine, and the resource requesting engine translates a resource request into a plurality of block requests and one or more block requests is canceled by satisfying the request using predictively streamed blocks found in the cache.