Video stream

• US 9,426,476 B2
• Filed: 07/09/2012
• Issued: 08/23/2016
• Est. Priority Date: 07/09/2012
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Roisenberg, Paulo, Prauchner, Joao Luis, Krauthein, Adriano Silveira, Lukasik, Derek, Walls, Jeffrey Joel, Nylund, Mark Edward, Novaes, Reynaldo Cardoso
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): Zhou, Zhihan
• Application Number:
  US13/544,296
• Publication Number:
  US 20140010289A1
• Time in Patent Office: 1,506 Days
• Field of Search: 375/240.08
• US Class Current: 1/1
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field

Abstract

An example system can comprise a memory to store machine readable instructions. The system can also comprise a processing unit to execute the machine readable instructions. The machine readable instructions can a server can comprise a codec selector to dynamically partition a video stream into a plurality of partitions based on graphical elements of the video stream, such that a given frame of the video stream is divided into the plurality of partitions. The codec selector can also select a plurality of different codecs to compress the plurality of partitions based on the graphical elements of the video stream.

Claims

1. A system comprising:

a memory to store machine readable instructions; and

a processing unit to access the memory and execute the machine readable instructions, the machine readable instructions comprising;

a server comprising

a codec selector including a plurality of application programming interfaces (APIs), the codec selector to;

dynamically partition a video stream into a plurality of partitions based on graphical elements of the video stream, such that a given frame of the video stream is divided into the plurality of partitions;

assign a first codec to a first partition among the plurality of partitions to compress the first partition in response to a determination that the graphical elements of the first partition include text or two dimensional graphics;

assign a second codec to a second partition among the plurality of partitions to compress the second partition in response to a determination that the graphical elements of the second partition include three dimensional graphics; and

assign a third codec to a third partition among the plurality of partitions to compress the third partition in response to a determination that the graphical elements of the third partition include video data; and

a codec mapper to merge each compressed partition to provide a compressed video stream to the client interface, wherein a given frame of the compressed video stream is compressed with multiple encoding schemes;

wherein the compressed video stream comprises;

mapping data that characterizes a compression format of each of the compressed partitions; and

boundary data that characterizes a boundary of each of the compressed partitions.

2. The system of claim 1, wherein the video stream represents a real-time desktop associated with the server.

3. The system of claim 1, wherein each of the first, second, and third codec compress each respective partition into a different respective compression format.

4. The system of claim 1, wherein the codec selector is further to employ a hierarchy of heuristics to select a given codec of the plurality of codecs for a given partition of the plurality of partitions.

5. The system of claim 4, wherein a given heuristic of the hierarchy of heuristics comprises an examination of commands employed to generate a graphical element in the given partition of the plurality of partitions.

6. The system of claim 4, wherein a given heuristic of the hierarchy comprises an examination of a number of colors employed to generate a graphical element in the given partition of the video stream.

7. The system of claim 1, wherein the APIs each interfaces with a component of the system employed to facilitate generation of the graphical elements of the video stream, such that a respective API is to determine a boundary of each partition of the plurality of partitions in the video stream.

8. The system of claim 1, wherein the codec selector is further to:

periodically re-partition the video stream into another plurality of partitions based on graphical elements of the video stream at a time of the periodic re-partitioning, such that another frame of the video stream is divided into the another plurality of partitions; and

select a plurality of different codecs to compress the another plurality of partitions based on the graphical elements of the video stream at a time of the periodic re-partitioning.

9. The system of claim 1, wherein the codec selector includes a mirror driver in communication with a first API among the plurality of APIs, the mirror driver to determine which partition of the video stream contains text and/or two-dimensional graphics.

10. The system of claim 1, wherein the codec selector includes a three dimensional (3-D) rendering engine coupled to a second API among the plurality of APIs to determine which partition among the plurality of partitions contains 3-D rendered data.

11. The system of claim 1, further including a video player coupled to a third API among the plurality of APIs to determine which partition among the plurality of partitions contains a video.

12. The system of claim 1, further comprising a decoding codec to decompress the video stream.

13. A method comprising:

analyzing, using a codec selector comprising a plurality of application programming interfaces (APIs), a video stream that characterizes a series of successive frames of video to select a boundary of a plurality of partitions of the video stream, wherein the boundary of each partition of the plurality of partitions is based on characteristics of a graphical element within a respective partition of the plurality of partitions;

labeling each of the plurality of partitions with a label using the plurality of APIs;

assigning, using the codec selector, a different respective codec among the plurality of different codecs to each of the respective partitions labeled by the plurality of APIs, such that;

a first codec is assigned to a first partition among the plurality of partitions to compress the first partition in response to a determination that the graphical elements of first partition include text or two dimensional graphics;

a second codec is assigned to a second partition among the plurality of partitions to compress the second partition in response to a determination that the graphical elements of the second partition include three dimensional graphics; and

a third codec is assigned to a third partition among the plurality of partitions to compress the third partition in response to a determination that the graphical elements of the third partition include video data;

receiving a compressed partition from each of the plurality of codecs; and

generating a compressed video stream, the compressed video stream comprising;

each of the compressed partitions;

mapping data that characterizes compression format of each of the compressed partitions; and

boundary data that characterizes a boundary of each of the compressed partitions.

14. The method of claim 13, further comprising:

providing the compressed video stream to a client over a network; and

decompressing the compressed video stream at the client based on the mapping data.

15. The method of claim 13, wherein the first codec employs run length encoding to compress the first partition.

16. The method of claim 13, wherein the second codec employs discrete cosine transform (DCT) or DCT with temporal compression to compress the second partition.

17. A non-transitory computer readable medium to store machine readable instructions, the machine readable instructions comprising:

a server comprising;

a client interface to process a request for a video stream comprising a plurality of successive frames provided from a client computer via a network;

a codec selector comprising;

a plurality of application programming interfaces (APIs), each API to;

monitor a component of a system control that facilitates generation of graphical elements in the video stream;

identify a partition of the video stream that provides a type of graphical element; and

label a different partition of the video stream;

wherein the codec selector assigns;

a first codec to a first partition among the plurality of partitions labeled by the plurality of APIs, in response to a determination that the graphical elements of the first partition include text or two dimensional graphics;

a second codec to a second partition among the plurality of partitions to compress the second partition in response to a determination that the graphical elements of the second partition include three dimensional graphics; and

a third codec to a third partition among the plurality of partitions to compress the third partition in response to a determination that the graphical elements of the third partition include video data; and

a codec mapper to merge each compressed partition to provide a compressed video stream to the client interface, wherein a given frame of the compressed video stream is compressed with multiple encoding schemes;

wherein the compressed video stream comprises;

mapping data that characterize compression format of each of the compressed partitions; and

boundary data that characterizes a boundary of each of the compressed partitions.