Adaptive video compression of graphical user interfaces using application metadata

• US 7,548,657 B2
• Filed: 06/25/2005
• Issued: 06/16/2009
• Est. Priority Date: 06/25/2005
• Status: Expired due to Fees

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Deaven, David M
• Primary Examiner(s): Alavi; Amir
• Application Number:
  US11/165,768
• Publication Number:
  US 20060294125A1
• Time in Patent Office: 1,452 Days
• Field of Search: 382/162, 382/164, 382/173, 382/232, 382/233, 382/239, 382/243, 382/270, 382/305, 375/240.15, 348/E5.108, 348/E5.112, 348/E7.071, 341/51, 341/86, 345/1.1, 345/1.2, 345/586, 370/401, 370/463, 370/466, 370/468, 370/477, 370/503, 707/101
• US Class Current: 382/243
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

Systems, methods and computer accessible medium are provided through which an input data stream consisting one or more media regions before entering a network to be rendered by a display coupled a remote video frame buffer is compressed on the basis of one or more configuration file metadata, source primitive metadata, and application high-level metadata of identified media regions. The input data stream is compressed by using one or more MPEG compression, JPEG compression, vector graphics compression, Huffman coding, or user defined compression scheme.

Claims

1. A method for compressing data between a source data device and a remote video frame buffer, comprising:

receiving source data from the source data device, the source data having one or more media regions that correspond to a video frame buffer location in the remote video frame buffer;

identifying metadata, at a computer, that describes the one or more media regions that correspond to the remote video frame buffer location;

performing a metadata dependent data compression on the region, if the metadata of the region is identified; and

selecting a metadata independent data compression on a region that is not metadata identified.

2. The method of claim 1, wherein identifying metadata further comprises:

identifying one of configuration file metadata, source primitive metadata, application high-level metadata;

wherein selecting metadata independent data compression further comprises;

one of MPEG compression, JPEG image compression, vector graphics compression, Huffman coding, H.261, user selected.

3. The method of claim 2, wherein identifying metadata further comprises:

one of;

identifying application high-level metadata on functions and type of display for regions of input data,

identifying source primitive metadata on application metadata from primitive operations,

identifying information defining regions of the input data, and

identifying information defining special and temporal characteristics of input data regions.

4. A method for transmitting mixed media stream data from a data processor over a communication link to a remote frame buffer for displaying, the method comprising:

dividing the mixed media stream data into a number of regions, the regions representing mixed media stream to be displayed;

acquiring from the data processor a metadata attribute that defines each region of the mixed media stream data;

selecting a compression method for each region of the mixed media stream data on the basis of the acquired metadata attribute that defines each region of the mixed media stream data;

applying the selected compression method for each region of the mixed media stream data; and

transmitting the compressed mixed media stream data over the communication link to the frame buffer for displaying.

5. The data compression method of claim 4, wherein the metadata attribute further comprises one of configuration file metadata, source primitive metadata, application high-level metadata.

6. The data compression method of claim 5, wherein the metadata attribute of the configuration file metadata further comprises at least one of information defining geometric regions of the input data and information defining special and temporal characteristics of input data regions.

7. The data compression method of claim 5, wherein the metadata attribute of the source primitive metadata further comprises application metadata from primitive operations.

8. The data compression method of claim 5, wherein the metadata attribute of application high-level metadata further comprises information describing functions and type of display for regions of the input data.

9. The data compression method of claim 4, wherein selecting at least one data compression method further comprises one of MPEG compression, JPEG image compression, vector graphics compression, Huffman coding, H.261, user selected.

10. The data compression method of claim 4, wherein a metadata attribute further comprises one of application high-level metadata on functions and type of display for regions of input data, source primitive metadata on application metadata from primitive operations, information defining regions of the input data, information defining special and temporal characteristics of input data regions;

and

wherein selecting at least one data compression method is one of MPEG compression, JPEG image compression, vector graphics compression, Huffman coding, H.261, user selected.

11. A computer-accessible storage memory having executable instructions to transmitting mixed media stream data from a data processor over a communications link to a remote frame buffer for displaying , the executable instructions capable of directing a processor to perform:

dividing the mixed media stream data into a number of regions, the regions representing mixed media stream to be displayed;

acquiring from the data processor metadata that defines each region of the mixed media stream data;

selecting a compression method for each region of the mixed media stream data on the basis of the acquired metadata that defines each region of the mixed media stream data;

applying the selected compression method for each region of the mixed media stream data; and

transmitting the compressed mixed media stream data over the communication link to the frame buffer for displaying.

12. The computer-accessible storage memory of claim 11, wherein acquiring is one of identifying application high-level metadata on functions and type of display for regions of the mixed media stream data, identifying source primitive metadata on application metadata from primitive operations, identifying information defining special and temporal characteristics of the mixed media stream data regions.

13. A computerized system for compressing at least one set of input data comprising:

a device for identifying at least one attribute of the input data, wherein the at least one attribute further comprises one of configuration file metadata, source primitive metadata, application high-level metadata;

a device for selecting at least one data compression method in response to the identified attribute; and

a device for compressing the set of input data with the selected at least one data compression method.

14. The computerized system of claim 13, further comprising a transmitter for transmitting the compressed data over a communication link to a frame buffer for display.

15. The computerized system of claim 14, wherein the attribute of configuration file metadata further comprises at least one of information defining regions of the input data, information defining special and temporal characteristics of input data regions.

16. The computerized system of claim 14, wherein the attribute of source primitive metadata further comprises application metadata from primitive operations.

17. The computerized system of claim 14, wherein the attribute of application high-level metadata further comprises information describing functions and type of display for regions of the input data.

18. The computerized system of claim 17, wherein selecting at least one data compression method further comprises one of MPEG compression, JPEG image compression, vector graphics compression, Huffman coding, H.261, user selected.

19. The computerized system of claim 18, wherein an attribute further comprises one of application high-level metadata describing functions and type of display for regions of input data, source primitive metadata on application metadata from primitive operations, information defining regions of the input data, information defining special and temporal characteristics of input data regions;

and

wherein selecting at least one data compression method further comprises one of MPEG compression, JPEG image compression, vector graphics compression, Huffman coding.

20. A computerized system for transmitting mixed media stream data from a data processor over a communications link to a remote frame buffer for displaying, comprising:

device for dividing the mixed media stream data into a number of regions, the regions representing mixed media stream to be displayed;

device for acquiring from the data processor metadata that defines each region of the mixed media stream data;

device for selecting a compression method for each region of the mixed media stream data on the basis of the acquired metadata that defines each region of the mixed media stream data;

device for applying the selected compression method for each region of the mixed media stream data; and

transmitter for transmitting the compressed mixed media stream data over the communication link to the frame buffer for displaying.

21. The computerized system of claim 20, wherein acquiring further comprises one of identifying application high-level metadata on functions and type of display for regions of the mixed media stream data, identifying source primitive metadata on application metadata from primitive operations, identifying information defining special and temporal characteristics of the mixed media stream data regions.

22. A system to exchange mixed media stream data from a media source over a communications link to a remote frame buffer for displaying comprising:

a processor;

a storage device coupled to the processor; and

software means operative on the processor for;

dividing the mixed media stream data into a number of regions, the regions representing mixed media stream to be displayed;

acquiring from the media source metadata that defines each region of the mixed media stream data;

selecting a compression method for each region of the mixed media stream data on the basis of the acquired metadata that defines each region of the mixed media stream data;

applying the selected compression method for each region of the mixed media stream data; and

transmitting the compressed mixed media stream data over the communication link to the frame buffer for displaying.

23. The system of claim 22, wherein the acquiring further comprises one of:

identifying application high-level metadata describing functions and type of display for regions of the mixed media stream data,

identifying source primitive metadata on application metadata from primitive operations, and

identifying information defining special and temporal characteristics of the mixed media stream data regions.

24. A data compression system for compressing at least one set of input data comprising:

a processor;

a storage device coupled to the processor; and

software means operative on the processor for;

receiving input data;

identifying at least one metadata attribute of the input data;

selecting at least one data compression method in response to the identified metadata attribute; and

compressing the set of input data with the selected at least one data compression method.

25. The data compression system of claim 24, wherein the metadata attribute further comprises one of configuration file metadata, source primitive metadata, application high-level metadata;

wherein the metadata attribute of configuration file metadata further comprises at least one of information defining regions of the input data, information defining special and temporal characteristics of input data regions;

wherein the metadata attribute of source primitive metadata further comprises application metadata from primitive operations;

wherein the metadata attribute of application high-level metadata further comprises information on functions and type of display for regions of the input data;

wherein selecting at least one data compression system further comprises one of MPEG compression, JPEG image compression, vector graphics compression, Huffman coding, H.261, user selected.