Progressive block encoding using region analysis

• US 9,020,045 B1
• Filed: 12/20/2012
• Issued: 04/28/2015
• Est. Priority Date: 07/28/2005
• Status: Expired due to Fees

• Current Assignee: Teradici Corporation (HP Inc.)
• Original Assignee: Teradici Corporation (HP Inc.)
• Inventors: Hobbs, David Victor, Ratto, Patrick
• Primary Examiner(s): Ustaris, Joseph
• Assistant Examiner(s): MCINNISH, KEVIN K
• Application Number:
  US13/722,105
• Time in Patent Office: 859 Days
• US Class Current: 375/240.24
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 19/102 characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/507 using conditional replenishment

Abstract

Methods of encoding an image stream. In one embodiment, the method comprises generating, by a computer, a lossless encoding of a first portion of a frame of an image based on identifying the first portion as (i) changed since a previous frame of the image and (ii) comprising a first image type; generating an initial quality lossy encoding of a second portion of the frame based on identifying the second portion as (iii) changed since the previous frame and (iv) comprising a second image type; and generating a quality improvement encoding of a third portion of the frame based on identifying the third portion as (v) unchanged since the previous frame and (vi) encoded to less than a defined quality.

Claims

1. A method of encoding an image stream at a host computer, comprising:

generating the image stream by the host computer, the image stream comprising a plurality of image frames, each image frame comprising at least a video insert portion, a text portion and a picture portion;

generating, by the host computer, an encoding of a first block of pixels of a frame of the image stream, wherein the encoding of the first block is generated at a lossless coding quality level if the first block (i) has changed with respect to a corresponding block in a directly previous frame of the image stream and (ii) comprises a first image type identified by a first static image property;

generating an encoding of a second block of pixels of the frame, wherein the encoding of the second block is generated at a first lossy coding quality level if the second block (iii) has changed with respect to a corresponding block in the directly previous frame and (iv) comprises a second image type identified by a second static image property;

generating an encoding of a third block of pixels of the frame at an initial encoding quality level if the third block of pixels comprises the second image type and the third block of pixels is changed from a first reference corresponding block of pixels in the directly previous frame;

generating an encoding of the third block of pixels at a previous encoding quality level if the third block comprises the second image type, the third block of pixels is unchanged from the first reference corresponding block of pixels, and the third block is changed from a second reference corresponding block in a frame at least two frames previous to the frame;

generating an encoding of the third block at an increased encoding quality level greater than the initial encoding quality level if the third block comprises the second image type, the third block is unchanged since the second reference corresponding block;

generating an unchanged indication with respect to a fourth block of pixels of the frame if the fourth block (v) has remained unchanged with respect to a corresponding block in the directly previous frame, (vi) comprises the second image type and (vii) is changed with respect to a sixth corresponding block in a frame previous to the directly previous frame; and

transmitting the encoded first block of pixels, the encoded second block of pixels, the encoded third block of pixels and the unchanged indication with respect to the fourth block of pixels to a client computer for display as part of a decoding of an encoding of the image stream,

wherein coding quality level of each block defines a measurable image quality level of a corresponding block in the decoding.

2. The method of claim 1, further comprising using image decomposition filters to identify that the first block comprises, the first image type and that the second, the third and the fourth blocks comprise the second image type.

3. The method of claim 1, wherein the unchanged indication is generated if a build state of the fourth block of pixels, generated as part of encoding the directly previous frame, identifies one of a final coding quality level or a delaying of an encoded quality build sequence, for the fourth block of pixels.

4. The method of claim 1, further comprising updating a build state table, wherein the build state table identifies, for each block of pixels of a plurality of blocks of pixels of the frame, (a) a current build state and a number of frames that have passed since the each block of pixels has changed, and (b) a number of quality levels to be encoded, and wherein generating the encoding of the first block comprises updating the build state table to identify the first block as unchanged for zero frames, generating the encoding of the second block comprises updating the build state table to identify the second block as unchanged for zero frames, and generating an encoding of the fourth block comprises updating the build state table to identify the fourth block as unchanged for one additional frame.

5. The method of claim 4, wherein generating the encodings of the first, the second, the third and the fourth blocks comprises updating the build state table to identify the first block as encoded to the lossless coding quality level, the second block as encoded to the first lossy coding quality level, and the fourth block as encoded to the first lossy coding quality level.

6. The method of claim 1, wherein a previous coding quality level of the third block of pixels is identified as less than a defined quality coding level by referencing a record in a build state table, and wherein the record is generated as part of a previous encoding of the third block of pixels.

7. The method of claim 1, wherein generating the encoding of the third block at the increased encoding quality level comprises encoding an additional bit plane of a discrete transform of the third block.

8. The method of claim 1, further comprising transmitting, over an inter-computer network, the encodings of the first, the second, and the third blocks, and the unchanged indication.