Virtual frame buffer system and method

• US 10,212,440 B2
• Filed: 04/20/2017
• Issued: 02/19/2019
• Est. Priority Date: 07/07/2010
• Status: Active Grant

• Current Assignee: Netzyn, Inc.
• Original Assignee: Netzyn, Inc.
• Inventors: Bakke, Steve
• Primary Examiner(s): Zhou, Zhihan
• Application Number:
  US15/492,212
• Publication Number:
  US 20170289559A1
• Time in Patent Office: 670 Days
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G09G 2310/04 Partial updating of the display screen
• CPC Class Codes: G09G 2320/103 Detection of image changes, e.g. determination of an index representative of the image change
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2360/18 Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 5/395 Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen G09G5/399 takes precedence
• CPC Class Codes: G09G 5/397 Arrangements specially adapted for transferring the contents of two or more bit-mapped memories to the screen simultaneously, e.g. for mixing or overlay G09G5/02 takes precedence
• CPC Class Codes: G09G 5/399 using two or more bit-mapped memories, the operations of which are switched in time, e.g. ping-pong buffers
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/433 characterised by techniques for memory access
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/507 using conditional replenishment
• CPC Class Codes: H04N 19/513 Processing of motion vectors

Abstract

A system for encoding and decoding a frame (also file), such as a video, graphic, media, or other frame or data, representing a real-time graphic output from a frame buffer, output by a video camera, or another file or data. The file includes frames each comprising macroblocks. Reference frame buffers (PFTs), virtual frame buffer tables (VFTBs) of equal number to the PFTs, each VFTB corresponds to a respective PFT, and respective sectors of each PFT for respective macroblocks are created. Frames of the file are encoded/decoded by successive encode/decode of macroblocks. A pointer is created in the VFBT associated with the PFT rather than encoding/decoding any matching macroblock. The pointer and its reference are relied on for each already encoded/decoded macroblock retained in the PFT. Processing, memory, bandwidth and power requirements for encoding or decoding are reduced.

Claims

1. A system for encoding a file, the file comprises frames and each frame comprises macroblocks, comprising:

memory;

a processor communicatively connected to the memory;

a first physical frame buffer in the memory, the first physical frame buffer includes a plurality of first sectors, each first sector capable of storing a respective one of the macroblocks of any one of the frame;

a first virtual frame buffer table in the memory, the first virtual frame buffer table is a single bit array in the memory and each single bit of the array is positioned in the array to indirectly reference a respective one of the first sectors; and

a respective first pointer stored in the first virtual frame buffer table, the respective first pointer corresponds to a respective one of the first sectors and refers to (i) if the macroblock of the respective one of the first sectors is not matched by another macroblock of another respective one of the first sectors, the respective one of the first sectors containing the macroblock; and

(ii) if the macroblock of the respective one of the first sectors is matched by another macroblock of another respective one of the first sectors, the other respective one of the first sectors containing the other macroblock;

wherein, during encoding, either each next one of the macroblock of the frame is encoded or, if the next one of the macroblock is matched by another macroblock of another respective one of the first sectors having then-been encoded, encoding of the next one of the macroblock is skipped and the respective first pointer refers to the other macroblock of the other respective one of the first sectors.

2. The system of claim 1, further comprising:

an encoder communicatively connected to the memory.

3. The system of claim 1, further comprising:

a second physical frame buffer in the memory, the second physical frame buffer includes a plurality of second sectors, each second sector capable of storing a respective one of the macroblocks of any one of the frame;

a second virtual frame buffer table in the memory, the second virtual frame buffer table is a single bit array in the memory and each single bit of the array is positioned in the array to indirectly reference a respective one of the second sectors;

a third physical frame buffer in the memory, the third physical frame buffer includes a plurality of third sectors, each third sector capable of storing a respective one of the macroblocks of any one of the frame;

a third virtual frame buffer table in the memory, the third virtual frame buffer table is a single bit array in the memory and each single bit of the array is positioned in the array to indirectly reference a respective one of the third sectors; and

a respective second pointer stored in the second virtual frame buffer table, the respective second pointer corresponds to a respective one of the second sectors and refers to (i) if the macroblock of the respective one of the second sectors is not matched by another macroblock of another sector selected from the group consisting of the first sectors and the third sectors, the respective one of the second sectors containing the macroblock; and

(ii) if the macroblock of the respective one of the second sectors is matched by another macroblock of another sector selected from the group consisting of the first sectors and the third sectors, the other sector containing the other macroblock;

a respective third pointer stored in the third virtual frame buffer table, the respective third pointer corresponds to a respective one of the third sectors and refers to (i) if the macroblock of the respective one of the third sectors is not matched by another macroblock of another sector selected from the group consisting of the first sectors and the second sectors, the respective one of the third sectors containing the macroblock; and

(ii) if the macroblock of the respective one of the third sectors is matched by another macroblock of another sector selected from the group consisting of the first sectors and the second sectors, the other sector containing the other macroblock;

wherein the respective first pointer stored in the first virtual frame buffer table corresponds to a respective one of the first sectors and refers instead to (i) if the macroblock of the respective one of the first sectors is not matched by another macroblock of another sector selected from the group consisting of the second sectors and the third sectors, the respective one of the first sectors containing the macroblock; and

(ii) if the macroblock of the respective one of the first sectors is matched by another macroblock of another sector selected from the group consisting of the second sectors and the third sectors, the other sector containing the other macroblock.

4. The system of claim 3, further comprising:

an encoder communicatively connected to the memory.

5. A method of encoding a file, the file comprises frames and each frame comprises macroblocks, comprising:

encoding a frame of the file, by successively encoding each respective macroblock of the frame, unless any macroblock previously encoded and then-retained in any respective one of first sectors of a first physical frame buffer is the same as the respective macroblock;

storing each respective macroblock from encoding in the first physical frame buffer in a respective one of the first sectors, except not storing the respective macroblock from encoding if any macroblock previously encoded and then-retained in any respective one of the first sectors of the first physical frame buffer is the same as the respective macroblock; and

creating a respective first pointer in a first virtual frame buffer table associated with the first physical frame buffer, for each macroblock of the frame then-currently for encoding, if any macroblock previously encoded matches the macroblock and if the macroblock previously encoded is then-retained in the first physical frame buffer;

wherein, during encoding, either each next one of the macroblock of the frame is encoded or, if the next one of the macroblock is matched by another macroblock previously encoded of another one of the first sectors, encoding of the next one of the macroblock is skipped and the respective first pointer refers to the other macroblock previously encoded of the other one of the first sectors.

6. The method of claim 5, wherein

encoding includes determining whether any macroblock previously encoded matches the macroblock and whether the macroblock previously encoded is then-retained in the first physical frame buffer.

7. The method of claim 5, wherein encoding a frame of the file includes successively encoding each respective macroblock of the frame, unless any macroblock previously encoded and then-retained instead in any respective sector selected from the group consisting of second sectors of a second physical frame buffer and third sectors of a third physical frame buffer is the same as the respective macroblock;

wherein storing each respective macroblock from encoding includes storing the respective macroblock in the first physical frame buffer in a respective one of the first sectors, except not storing the respective macroblock from encoding if any macroblock previously encoded and then-retained instead in any respective sector selected from the group consisting of the second sectors of the second physical frame buffer and the third sectors of the third physical frame buffer is the same as the respective macroblock;

wherein creating a respective first pointer in a first virtual frame buffer table associated with the first physical frame buffer includes, for each macroblock of the frame then-currently for encoding, if any macroblock previously encoded matches the macroblock and if the macroblock previously encoded is then-retained instead in any physical frame buffer selected from the group consisting of the second physical frame buffer and the third physical frame buffer, the respective first pointer points to the macroblock previously encoded.

8. The method of claim 7, wherein

encoding includes determining whether any macroblock previously encoded matches the macroblock and whether the macroblock previously encoded is then-retained instead in the physical frame buffer selected from the group consisting of the second physical frame buffer and the third physical frame buffer.

9. The method of claim 5, wherein the first virtual frame buffer table is a single bit array.

10. A system for decoding an encoded file, the encoded file comprises encoded frames and each encoded frame comprises encoded macroblocks, comprising:

memory;

a processor communicatively connected to the memory;

a first physical frame buffer in the memory, the first physical frame buffer capable of containing one of the encoded frame once decoded, the first physical frame buffer includes a plurality of first sectors, each first sector capable of storing a respective one of the encoded macroblocks once decoded of the one of the encoded frame;

a first virtual frame buffer table in the memory, the first virtual frame buffer table is a single bit array in the memory and each single bit of the array is positioned in the array to indirectly reference a respective one of the first sectors; and

a respective first pointer stored in the first virtual frame buffer table, the respective first pointer corresponds to a respective one of the first sectors and refers to (i) if the encoded macroblock once decoded of the respective one of the first sectors is not matched by another encoded macroblock once decoded of another respective one of the first sectors, the respective one of the first sectors containing the encoded macroblock once decoded; and

(ii) if the encoded macroblock once decoded of the respective one of the first sectors is matched by another encoded macroblock once decoded of another respective one of the first sectors, the other respective one of the first sectors containing the other encoded macroblock once decoded;

wherein, during decoding, either each next one of the encoded macroblock of the encoded frame is decoded or, if the next one of the encoded macroblock once decoded is matched by another encoded macroblock once decoded of another respective one of the first sectors, decoding of the next one of the encoded macroblock is skipped and the respective first pointer refers to the other encoded macroblock once decoded of the other respective one of the first sectors.

11. The system of claim 10, further comprising:

a decoder communicatively connected to the memory.

12. The system of claim 10, further comprising:

a second physical frame buffer in the memory, the second physical frame buffer includes a plurality of second sectors, each second sector capable of storing a respective one of the encoded macroblocks once decoded of any one of the encoded frame;

a second virtual frame buffer table in the memory, the second virtual frame buffer table is a single bit array in the memory and each single bit of the array is positioned in the array to indirectly reference a respective one of the second sectors;

a third physical frame buffer in the memory, the third physical frame buffer includes a plurality of third sectors, each third sector capable of storing a respective one of the encoded macroblocks once decoded of any one of the encoded frame;

a third virtual frame buffer table in the memory, the third virtual frame buffer table is a single bit array in the memory and each single bit of the array is positioned in the array to indirectly reference a respective one of the third sectors; and

a respective second pointer stored in the second virtual frame buffer table, the respective second pointer corresponds to a respective one of the second sectors and refers to (i) if the encoded macroblock once decoded of the respective one of the second sectors is not matched by another encoded macroblock once decoded of another sector selected from the group consisting of the first sectors and the third sectors, the respective one of the second sectors containing the encoded macroblock once decoded; and

(ii) if the encoded macroblock once decoded of the respective one of the second sectors is matched by another encoded macroblock once decoded of another sector selected from the group consisting of the first sectors and the third sectors, the other sector containing the other encoded macroblock once decoded;

a respective third pointer stored in the third virtual frame buffer table, the respective third pointer corresponds to a respective one of the third sectors and refers to (i) if the encoded macroblock once decoded of the respective one of the third sectors is not matched by another encoded macroblock once decoded of another sector selected from the group consisting of the first sectors and the second sectors, the respective one of the third sectors containing the encoded macroblock once decoded; and

(ii) if the encoded macroblock once decoded of the respective one of the third sectors is matched by another encoded macroblock once decoded of another sector selected from the group consisting of the first sectors and the second sectors, the other sector containing the other encoded macroblock once decoded;

wherein the respective first pointer stored in the first virtual frame buffer table corresponds to a respective one of the first sectors and refers instead to (i) if the encoded macroblock once decoded of the respective one of the first sectors is not matched by another encoded macroblock once decoded of another sector selected from the group consisting of the second sectors and the third sectors, the respective one of the first sectors containing the encoded macroblock once decoded; and

(ii) if the encoded macroblock once decoded of the respective one of the first sectors is matched by another encoded macroblock once decoded of another sector selected from the group consisting of the second sectors and the third sectors, the other sector containing the other encoded macroblock once decoded.

13. The system of claim 12, further comprising:

a decoder communicatively connected to the memory.

14. A method of decoding an encoded file, the encoded file comprises encoded frames and each encoded frame comprises encoded macroblocks, comprising:

decoding an encoded frame of the encoded file, by successively decoding each respective encoded macroblock of the encoded frame, unless any encoded macroblock previously decoded and then-retained in any respective one of first sectors of a first physical frame buffer is the same as the respective encoded macroblock;

storing each respective encoded macroblock from decoding in the first physical frame buffer in a respective one of the first sectors, except not storing the respective encoded macroblock from decoding if any encoded macroblock previously decoded and then-retained in any one of the first sectors of the first physical frame buffer is the same as the respective encoded macroblock; and

creating a respective pointer in a first virtual frame buffer table associated with the first physical frame buffer, for each encoded macroblock of the encoded frame then-currently for decoding, if any encoded macroblock previously decoded matches the encoded macroblock and if the encoded macroblock previously decoded is then-retained in the first physical frame buffer;

wherein, during decoding, either each next one of the encoded macroblock of the encoded frame is decoded or, if the next one of the encoded macroblock is matched by another encoded macroblock previously decoded of another one of the first sectors, decoding of the next one of the encoded macroblock is skipped and the respective first pointer refers to the other encoded macroblock previously decoded of the other one of the first sectors.

15. The method of claim 14, wherein

decoding includes determining whether any encoded macroblock previously decoded matches the encoded macroblock and whether the encoded macroblock previously encoded is then-retained in the first physical frame buffer.

16. The method of claim 14, wherein decoding an encoded frame of the file includes successively decoding each respective encoded macroblock of the encoded frame, unless any encoded macroblock previously decoded and then-retained instead in any respective sector selected from the group consisting of second sectors of a second physical frame buffer and third sectors of a third physical frame buffer is the same as the respective encoded macroblock;

wherein storing each respective encoded macroblock from decoding includes storing the respective encoded macroblock in the first physical frame buffer in a respective one of the first sectors, except not storing the respective encoded macroblock from decoding if any encoded macroblock previously decoded and then-retained instead in any respective sector selected from the group consisting of the second sectors of the second physical frame buffer and the third sectors of the third physical frame buffer is the same as the respective encoded macroblock;

wherein creating a respective first pointer in a first virtual frame buffer table associated with the first physical frame buffer includes, for each encoded macroblock of the frame then-currently for decoding, if any encoded macroblock previously decoded matches the encoded macroblock and if the encoded macroblock previously decoded is then-retained instead in any physical frame buffer selected from the group consisting of the second physical frame buffer and the third physical frame buffer, the respective first pointer points to the encoded macroblock previously decoded.

17. The method of claim 16, wherein

decoding includes determining whether any encoded macroblock previously decoded matches the encoded macroblock and whether the encoded macroblock previously decoded is then-retained instead in the physical frame buffer selected from the group consisting of the second physical frame buffer and the third physical frame buffer.

18. The method of claim 14, wherein the first virtual frame buffer table is a single bit array.