Graphic codec for network transmission

• US 7,376,278 B2
• Filed: 04/11/2006
• Issued: 05/20/2008
• Est. Priority Date: 01/31/2003
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Iwamura, Ryuichi
• Primary Examiner(s): Couso; Jose L.
• Application Number:
  US11/401,541
• Publication Number:
  US 20060182354A1
• Time in Patent Office: 770 Days
• Field of Search: 382232-233, 382236-240, 382244-250, 358/426.13, 358/426.14, 3483841-3901, 3483941-3951, 3484001-4041, 3484071-4101, 3484201-4221, 3484301-4311
• US Class Current: 382/236
• CPC Class Codes: G06F 3/1462 with means for detecting differences between the image stored in the host and the images displayed on the remote displays
• CPC Class Codes: G09G 2320/106 Determination of movement vectors or equivalent parameters within the image
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2358/00 Arrangements for display data security
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/58 Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one H04N19/23 takes precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

Various embodiments of the invention provide a method, system, and apparatus for transmitting screen display information from a remote server to a client. One embodiment features a video decoder that comprises (i) an input port to receive data that includes a data identifier to distinguish between a first data type and a second data type, (ii) a loss-less decoder, and (iii) a lossy decoder. The loss-less decoder is coupled to the data identifier and receives and decodes data of the first data type from the data identifier. The lossy decoder is coupled to the data identifier and receives and decodes data of the second data type from the data identifier.

Claims

1. A method comprising:

encoding a first block of graphics data using a lossy encoding scheme; and

encoding a second block of graphics data using a loss-less encoding scheme using intra-frame block matching, the intra-frame block matching includes,

determining if the first block may be matched to a neighboring block in a first display frame,

determining if the first block may be matched to other blocks within a certain region of the first display frame if no matching block is found in the neighboring blocks, and

sending information identifying a matching block instead of the actual first block if a matching block is found.

2. The method of claim 1 further comprises transmitting the first block being the matching block and the second block of graphics data from an encoder for subsequent decoding and use.

3. The method of claim 1 wherein the encoder monitors blocks of graphics data for a time period and determines to encode a selected block of data being the first block of graphics data using the lossy encoding scheme because the graphics data within the first block changes frequently while graphics data within the second block changes infrequently.

4. The method of claim 1 wherein the first block of graphics data is display graphics data encoded using Moving Picture Experts Group (MPEG) encoding and the second block of graphics data is display graphics data encoded using Differential Pulse Code Modulation (DPCM) encoding.

5. The method of claim 1 wherein, if no matching block is found, the method comprises:

selecting a third block that closely matches the first block in the same display frame, the third block closely matches the first block if both the third block and the first block have a minimum threshold of identically matching pixels; and

sending a vector identifying the third block as well as all dissimilar information between the first block and the third block to a decoder.

6. The method of claim 1 wherein, if no matching block is found, then the first block is encoded using the loss-less encoding scheme and the encoded information is sent to a decoder.

7. The method of claim 1 further comprising:

receiving motion information,

utilizing the motion information to estimate the matching block.

8. The method of claim 1, wherein the method is performed by software executed by a processor.

9. A video decoder comprising:

an input port to receive data;

a data identifier to (i) distinguish between a first data type and a second data type, (ii) determine a type of encoding employed on a first block, (iii) reconstruct the first block based on current frame information if intra-frame encoding was employed, (iv) reconstructs the first block based on previous frame information if inter-frame encoding was employed, (v) reconstructs the first block based on a combination of a second closely matched block in the current frame and dissimilar information between the first block and the second block, if a closely matched block was received, and (vi) reconstructs the first block by decoding all the received data if no matching block was identified;

a loss-less decoder coupled to the data identifier, the loss-less decoder to receive and decode data of the first data type from the data identifier; and

a lossy decoder coupled to the data identifier, the lossy decoder to receive and decode data of the second data type from the data identifier.

10. The video decoder of claim 9 wherein the first and second data types are graphical data types occurring in a first display frame.

11. The video decoder of claim 9 wherein the second data type is graphics data which changes more frequently than the first data type.

12. The video decoder of claim 9 further comprising:

a multiplexer coupled to receive data from the input port, and send the received data to either the lossy decoder or the loss-less decoder depending on the data type identified.

13. The video decoder of claim 9 further includes one or more frame memories, one of the one or more frame memories to store an earlier frame.

14. A video decoder comprising:

means for distinguishing between data of a first data type and a second data type;

means for determining a type of encoding employed on a first block;

means for reconstructing the first block based on current frame information if intra-frame encoding was employed;

means for reconstructing the first block based on previous frame information if inter-frame encoding was employed;

means for reconstructing the first block based on a combination of a second closely matched block in the current frame and dissimilar information between the first block and the second block, if a closely matched block was received;

means for reconstructing the first block by decoding all the received data if no matching block was identified;

a loss-less decoder to receive and decode data of the first data type; and

a lossy decoder to receive and decode data of the second data type.

15. The video decoder of claim 14 wherein the first and second data types are data blocks occurring in a first display frame.

16. The video decoder of claim 14 wherein the second data type is graphics data that changes more frequently than the first data type.

17. The video decoder of claim 16 further comprising:

an input port to receive the data; and

a multiplexer coupled to receive the data from the input port and to send the received data to the lossy decoder if the data is of the second data type or to the loss-less decoder if the data is of the first data type.

18. The video decoder of claim 14 wherein the lossy decoder comprises:

a first variable length decoder;

an inverse quantizer (IQ) coupled to the variable length decoder; and

an inverse discrete cosine transformer (IDCT) coupled to the IQ.

19. The video decoder of claim 18 wherein the loss-less decoder comprises:

a second variable length decoder; and

a Differential Pulse Code Modulation (DPCM) decoder.

20. The video decoder of claim 14 further comprising

an adder;

and

a first switch selectively coupling either the lossy decoder to the adder or the loss-less decoder to the adder.

21. The video decoder of claim 20 further comprising

a motion compensator (MC) selectively coupled to the adder when the first switch is coupled to the lossy decoder.

22. The video decoder of claim 14 being implemented within a device with display, input capabilities for receipt of the data and storage capabilities.