VIRTUAL FRAME BUFFER SYSTEM AND METHOD

• US 20190320194A1
• Filed: 02/18/2019
• Published: 10/17/2019
• Est. Priority Date: 07/07/2010
• Status: Abandoned Application

• Current Assignee: Netzyn, Inc.
• Original Assignee: Netzyn, Inc.
• Inventors: Bakke, Steve
• Application Number:
  US16/278,288
• Publication Number:
  US 20190320194A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G09G 2310/04 Partial updating of the display screen
• CPC Class Codes: G09G 2320/103 Detection of image changes, e.g. determination of an index representative of the image change
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2360/18 Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 5/395 Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen G09G5/399 takes precedence
• CPC Class Codes: G09G 5/397 Arrangements specially adapted for transferring the contents of two or more bit-mapped memories to the screen simultaneously, e.g. for mixing or overlay G09G5/02 takes precedence
• CPC Class Codes: G09G 5/399 using two or more bit-mapped memories, the operations of which are switched in time, e.g. ping-pong buffers
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/433 characterised by techniques for memory access
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/507 using conditional replenishment
• CPC Class Codes: H04N 19/513 Processing of motion vectors

Abstract

A system for encoding and decoding a frame (also file), such as a video, graphic, media, or other frame or data, representing a real-time graphic output from a frame buffer, output by a video camera, or another file or data. The file includes frames each comprising macroblocks. Reference frame buffers (PFTs), virtual frame buffer tables (VFTBs) of equal number to the PFTs, each VFTB corresponds to a respective PFT, and respective sectors of each PFT for respective macroblocks are created. Frames of the file are encoded/decoded by successive encode/decode of macroblocks. A pointer is created in the VFBT associated with the PFT rather than encoding/decoding any matching macroblock. The pointer and its reference are relied on for each already encoded/decoded macroblock retained in the PFT. Processing, memory, bandwidth and power requirements for encoding or decoding are reduced.

Claims

1. A device for encoding a file, the file comprises frames and each frame comprises macroblocks for encoding, comprising:

memory;

a processor communicatively connected to the memory;

an encoder communicatively connected to and controlled by the processor;

a plurality of reference frame buffers created in the memory by the encoder under control of the processor, wherein each reference frame buffer is distinct from any other of the plurality of reference frame buffers in the memory, each reference frame buffer capable of containing one of the frame;

a plurality of virtual frame buffer tables, equal in number to number of the reference frame buffers in the memory, created in the memory by the encoder under control of the processor;

a plurality of respective sectors of each reference frame buffer, respectively, each respective sector capable of storing one of the macroblocks corresponding to part of one of the frame of the file; and

a respective pointer created by the encoder during encoding, if any one of the macroblock of one of the frame of the file matches any macroblock of another one of the frames previously encoded by the encoder wherein any of the plurality of reference frame buffers then-retains the macroblock of the other of the frames;

wherein the encoder during encoding either encodes each next one of the macroblock of the frame or, if any macroblock of another one of the frames previously encoded is then-retained in any of the plurality of reference frame buffers, creates the respective pointer and stores the respective pointer in the virtual frame buffer table corresponding to the frame then being encoded.

3. A system according to claims 1 and 2, further comprising:

a communication link connecting the device of claim 1 to the device of claim 2.

4. The system of claim 3, wherein the communication link is a circuit.

5. The system of claim 3, wherein the communication link is selected from the group of:

wire, wireless link, cellular link, optic link, satellite, public switched telephone network, Internet, local area network, wireless local area network, or other communication network, or any combination of any or some of these.

6. A system according to claims 1 and 2, wherein at least certain of the device of claim 1 is the device of claim 2, and vice versa.

9. The device of claim 1,

wherein the file is a graphical type screen (such as a word processor or spreadsheet) of size about 5,000 to about 10,000 macroblocks;

and

wherein only about one to about ten macroblocks need be updated in a changed frame, wherein the processing, memory requirements, bandwidth and power are thereby reduced in encoding or decoding, respectively.

15. The device of claim 1, wherein the device is selected from the group consisting of:

circuit, computer program stored in memory, processor, and any combination of these.

17. A system according to claims 1 and 2, wherein at least certain of the device of claim 1 is the device of claim 2, and vice versa, and the system further comprises:

a communication network;

a first device connected to the communication network, the first node includes at least portions of the device of claim 1; and

a second device connected to the communication network, the second node includes at least portions of the device of claim 2;

wherein the encoded file is communicated by the first node to the second node over the network for decoding.

2. A device for decoding an encoded file, the encoded file comprises encoded frames and each frame comprises encoded macroblocks for decoding, comprising:

memory;

a processor communicatively connected to the memory;

a decoder communicatively connected to and controlled by the processor;

a plurality of reference frame buffers created in the memory by the decoder under control of the processor, wherein each reference frame buffer is distinct from any other of the plurality of reference frame buffers in the memory, each reference frame buffer capable of containing one of the encoded frame;

a plurality of virtual frame buffer tables, equal in number to number of the reference frame buffers in the memory, created in the memory by the decoder under control of the processor, each virtual frame buffer table, respectively, corresponds distinctly to one of the reference frame buffer, respectively;

a plurality of respective sectors of each reference frame buffer, respectively, each respective sector capable of storing one of the encoded macroblocks corresponding to part of one of the encoded frame of the encoded file; and

a respective pointer created by the decoder during decoding, if any one of the encoded macroblock of one of the encoded frame of the encoded file matches any encoded macroblock of another one of the encoded frames previously decoded by the decoder wherein any of the plurality of reference frame buffers then-retains the encoded macroblock of the other of the encoded frames;

wherein the decoder during decoding either decodes each next one of the encoded macroblock of the encoded frame or, if any encoded macroblock of another one of the encoded frames previously decoded is then-retained in any of the plurality of reference frame buffers, creates the respective pointer and stores the respective pointer in the virtual frame buffer table corresponding to the encoded frame then being decoded.

16. The device of claim 2, wherein the device is selected from the group consisting of:

circuit, computer program stored in memory, processor, and any combination of these.

18. The device of claim 2,

wherein the file is a graphical type screen (such as a word processor or spreadsheet) of size about 5,000 to about 10,000 macroblocks;

and

wherein only about one to about ten macroblocks need be updated in a changed frame, wherein the processing, memory requirements, bandwidth and power are thereby reduced in encoding or decoding, respectively.

7. A method of encoding a file, the file comprises frames and each frame comprises macroblocks for encoding, comprising the steps of:

creating in a memory a plurality of reference frame buffers, wherein each reference frame buffer is distinct from any other of the plurality of reference frame buffers in the memory, each reference frame buffer capable of containing one of the frame;

creating in the memory a plurality of virtual frame buffer tables, equal in number to number of the reference frame buffers in the memory, each virtual frame buffer table, respectively, corresponds distinctly to one of the reference frame buffer, respectively;

creating a plurality of respective sectors of each reference frame buffer, respectively, each respective sector sufficient for storage of one of the macroblocks corresponding to part of one of the frame of the file;

encoding one of the frames of the file, by successively encoding each respective one of the macroblocks of the one of the frame, unless any already encoded macroblock (if any) then-retained in any of the respective sectors of any of the reference frame buffers would be the same as the encoded macroblock, once encoded in the step of encoding;

storing respective ones of the encoded macroblocks, each respectively corresponding to respective ones of the macroblocks of the one of the frame of the file from the step of encoding, in respective ones of the plurality of respective sectors, except not storing one of the encoded macroblocks if any already encoded macroblock (if any) then-retained in any of the respective sectors of any of the reference frame buffers would be the same as the encoded macroblock, once encoded in the step of encoding;

creating a respective pointer in the virtual frame buffer table associated with the reference frame buffer then available for the step of encoding, for each macroblock (if any) of the frame then-currently for the step of encoding, if any macroblock of one of the frame previously encoded matches the macroblock of the step of creating a respective pointer and if the encoded macroblock of the frame previously encoded is then-retained in any of the reference buffer tables;

storing the respective pointer from the step of creating the respective pointer (if performed), in the virtual frame buffer table associated with the reference frame buffer for the step of encoding; and

returning to the step of encoding, but rather than encoding the macroblock in the step of encoding, relying on the respective pointer for encoding in order to reference the encoded macroblock;

wherein the encoder during encoding either encodes each next one of the macroblock of the frame or, if any macroblock of another one of the frames previously encoded is then-retained in any of the plurality of reference frame buffers, creates the respective pointer and stores the respective pointer in the virtual frame buffer table corresponding to the frame then being encoded.

10. The method of claim 7,

wherein the file is a graphical type screen (such as a word processor or spreadsheet) of size about 5,000 to about 10,000 macroblocks;

and

wherein only about one to about ten macroblocks need be encoded in the step of encoding for any frame of macroblocks not previously encoded, wherein the processing, memory requirements, bandwidth and power are thereby reduced in encoding.

12. An encode device operating in accordance with claim 7.

8. A method of decoding an encoded file, the encoded file comprises encoded frames and each encoded frame comprises encoded macroblocks for decoding and the file, when decoded, comprises frames and each frame comprises macroblocks, comprising the steps of:

creating in a memory a plurality of reference frame buffers, wherein each reference frame buffer is distinct from any other of the plurality of reference frame buffers in the memory, each reference frame buffer capable of containing one of the encoded frame;

creating in the memory a plurality of virtual frame buffer tables, equal in number to number of the reference frame buffers in the memory, each virtual frame buffer table, respectively, corresponds distinctly to one of the reference frame buffer, respectively;

creating a plurality of respective sectors of each reference frame buffer, respectively, each respective sector sufficient for storage of one of the macroblocks corresponding to part of one of the frame of the file;

decoding one of the encoded frames of the encoded file, by successively decoding each respective one of the encoded macroblocks of the one of the encoded frame, unless the encoded macroblock, once decoded, would match any macroblock previously decoded and then-retained in any of the respective sectors of any of the reference frame buffers;

storing respective ones of the macroblocks, each respectively corresponding to respective ones of the macroblocks of the one of the frame of the file from the step of decoding, in respective ones of the plurality of respective sectors, except not storing one of the macroblocks if the macroblock, once decoded, would match any macroblock previously decoded and then-retained in any of the respective sectors of any of the reference frame buffers;

creating a respective pointer in the virtual frame buffer table associated with the reference frame buffer then available for the step of decoding, for each encoded macroblock (if any) of the encoded frame then-currently for the step of decoding if the encoded macroblock, once decoded, would match any macroblock previously decoded and retained in any of the reference buffer tables;

storing the respective pointer from the step of creating the respective pointer (if performed), in the virtual frame buffer table associated with the reference frame buffer for the step of decoding; and

returning to the step of decoding, but rather than decoding the encoded macroblock in the step of decoding, relying on the respective pointer for decoding in order to reference the macroblock;

wherein the decoder during decoding either decodes each next one of the encoded macroblock of the encoded frame or, if any encoded macroblock of another one of the encoded frames previously decoded is then-retained in any of the plurality of reference frame buffers, creates the respective pointer and stores the respective pointer in the virtual frame buffer table corresponding to the encoded frame then being decoded.

11. The method of claim 8,

wherein the encoded file represents a graphical type screen (such as a word processor or spreadsheet) of size about 5,000 to about 10,000 macroblocks;

and

wherein only about one to about ten encoded macroblocks need be decoded in the step of decoding for any encoded frame of encoded macroblocks not previously decoded of another encoded frame, wherein the processing, memory requirements, bandwidth and power are thereby reduced in decoding.

13. A decode device operating in accordance with claim 8.

14. An encoder/decoder device for processing a single reference frame, comprising:

a virtual frame buffer table of a single bit array in a memory; and

a processor connected to the virtual frame buffer table for writing the single reference frame to the single bit array.