Reconstructing efficiently encoded video frames in a distributed video coding environment

• US 8,451,906 B1
• Filed: 02/25/2011
• Issued: 05/28/2013
• Est. Priority Date: 02/25/2011
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Rajagopalan, Shyam Sundar, Pai, Deepak, Revankar, Shriram V., Sood, Arsh, Chaitanya, Parimi Krishna
• Primary Examiner(s): Czekaj, David
• Assistant Examiner(s): Beck, Leron
• Application Number:
  US13/035,242
• Publication Number:
  US 20130128988A1
• Time in Patent Office: 823 Days
• Field of Search: 37524001-24029
• US Class Current: 375/240.24
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/234309 by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Systems and methods are presented for reconstructing sequences of video frames received from a sending device in a distributed video coding environment. Some of the video frames are received as key video frames fully encoded at the sending device. Others are received as non-key video frames partitioned into pixel blocks. Some of the pixel blocks are indicated for reconstruction via a corresponding previous pixel block of a previous video frame, while other pixel blocks are to be reconstructed by decoding encodings of those pixel blocks received from the sending device. Each received encoding of a pixel block is based on contents of the non-key video frame that contains the pixel block and not on contents of the previous key video frame, nor on contents of any other video frame positioned between the previous key video frame and the non-key video frame in the sequence of video frames.

Claims

1. A method, comprising:

reconstructing, by a computing device, a sequence of video frames received from a sending device, in which at least some of the video frames are key video frames and others of the video frames are non-key video frames, at least one pixel block of at least one of the non-key video frames is indicated for reconstruction via a corresponding previous pixel block of a previous video frame, and at least one pixel block of at least one of the non-key video frames is not indicated for reconstruction via the corresponding previous pixel block of the previous video frame, said reconstructing comprises, for each video frame of the sequence of video frames;

if the video frame is a key video frame, then reconstructing the key video frame based on decoding an encoding of the key video frame, the encoding of the key video frame is received from the sending device; and

if the video frame is a non-key video frame, then reconstructing the non-key video frame, said reconstructing comprises, for each particular pixel block of one or more pixel blocks of the non-key video frame;

if the particular pixel block is indicated for reconstruction via the corresponding previous pixel block of the previous video frame, then reconstructing the particular pixel block of the non-key video frame based on the corresponding previous pixel block of the previous video frame; and

if the particular pixel block is not indicated for reconstruction via the corresponding previous pixel block of the previous video frame, then reconstructing the particular pixel block of the non-key video frame based on decoding an encoding of the particular pixel block of the non-key video frame received from the sending device, the encoding of the particular pixel block based at least in part on contents of the non-key video frame that contains the particular pixel block and not on contents of the previous key video frame, nor on contents of any other video frame positioned between the previous key video frame and the non-key video frame in the sequence of video frames.

2. The method of claim 1, wherein said indicating that the particular pixel block is to be reconstructed via the corresponding previous pixel block of the previous video frame, and said indicating that the particular pixel block is to not be reconstructed via the corresponding previous pixel block of the previous video frame, are received from the sending device.

3. The method of claim 1, wherein the encoding of the particular pixel block of the non-key video frame received from the sending device is based on a singular value decomposition, at the sending device, of a matrix of pixel values for the particular pixel block.

4. The method of claim 3, wherein the encoding of the particular pixel block of the non-key video frame received from the sending device is an encoding of an approximation matrix that approximates the matrix of pixel values for the particular pixel block based on discarding one or more non-zero singular values obtained in the singular value decomposition, wherein the rank of the approximation matrix is less than the rank of the matrix of pixel values for the particular pixel block.

5. The method of claim 1, wherein the sending device is mobile computing device.

6. The method of claim 1, wherein said reconstructing the sequence of video frames is performed by a server which:

encodes the reconstructed sequence of video frames; and

sends the encoding of the reconstructed sequence of video frames to a third device, wherein the third device;

is not the sending device and is not the server; and

is configured to decode the encoding of the reconstructed sequence of video frames and to display the reconstructed sequence of video frames.

7. The method of claim 6, wherein the third device is a mobile computing device.

8. A system, comprising:

a processor; and

a memory coupled to the processor, wherein the memory stores program instructions for;

reconstructing a sequence of video frames received from a sending device, in which at least some of the video frames are key video frames and others of the video frames are non-key video frames, at least one pixel block of at least one of the non-key video frames is indicated for reconstruction via a corresponding previous pixel block of a previous video frame, and at least one pixel block of at least one of the non-key video frames is not indicated for reconstruction via the corresponding previous pixel block of the previous video frame, said reconstructing comprises, for video frames of the sequence of video frames;

if the video frame is a key video frame, then reconstructing the key video frame based on decoding an encoding of the key video frame, the encoding of the key video frame received from the sending device; and

if the video frame is a non-key video frame, then reconstructing the non-key video frame, said reconstructing comprising, for each particular pixel block of one or more pixel blocks of the non-key video frame;

if the particular pixel block is indicated for reconstruction via the corresponding previous pixel block of the previous video frame, then reconstructing the particular pixel block of the non-key video frame based on the corresponding previous pixel block of the previous video frame; and

if the particular pixel block is not indicated for reconstruction via the corresponding previous pixel block of the previous video frame, then reconstructing the particular pixel block of the non-key video frame based on decoding an encoding of the particular pixel block of the non-key video frame received from the sending device, the encoding of the particular pixel block based on contents of the non-key video frame that contains the particular pixel block and not on contents of the previous key video frame, nor on contents of any other video frame positioned between the previous key video frame and the non-key video frame in the sequence of video frames.

9. The system of claim 8, wherein said indicating that the particular pixel block is to be reconstructed via the corresponding previous pixel block of the previous video frame, and said indicating that the particular pixel block is to not be reconstructed via the corresponding previous pixel block of the previous video frame, are received from the sending device.

10. The system of claim 8, wherein the encoding of the particular pixel block of the non-key video frame received from the sending device is based on a singular value decomposition, at the sending device, of a matrix of pixel values for the particular pixel block.

11. The system of claim 10, wherein the encoding of the particular pixel block of the non-key video frame received from the sending device is an encoding of an approximation matrix that approximates the matrix of pixel values for the particular pixel block based on discarding one or more non-zero singular values obtained in the singular value decomposition, wherein the rank of the approximation matrix is less than the rank of the matrix of pixel values for the particular pixel block.

12. The system of claim 8, wherein the sending device is mobile computing device.

13. The system of claim 8, wherein said reconstructing the sequence of video frames is performed by a server which:

encodes the reconstructed sequence of video frames; and

sends the encoding of the reconstructed sequence of video frames to a third device, wherein the third device;

is not the sending device and is not the server; and

is configured to decode the encoding of the reconstructed sequence of video frames and to display the reconstructed sequence of video frames.

14. The system of claim 13, wherein the third device is a mobile computing device.

15. A tangible computer-readable storage device comprising instructions stored thereon that, responsive to execution by a computing device, causes the computing device to perform operations comprising:

reconstructing a sequence of video frames received from a sending device, in which at least some of the video frames are key video frames and others of the video frames are non-key video frames, at least one pixel block of at least one of the non-key video frames is indicated for reconstruction via a corresponding previous pixel block of a previous video frame, and at least one pixel block of at least one of the non-key video frames is not indicated for reconstruction via the corresponding previous pixel block of the previous video frame, said reconstructing comprises, for video frames of the sequence of video frames;

if the video frame is a key video frame, then reconstructing the key video frame based on decoding an encoding of the key video frame, the encoding of the key video frame received from the sending device; and

if the video frame is a non-key video frame, then reconstructing the non-key video frame, said reconstructing comprises, for each particular pixel block of one or more pixel blocks of the non-key video frame;

if the particular pixel block is indicated for reconstruction via the corresponding previous pixel block of the previous video frame, then reconstructing the particular pixel block of the non-key video frame based on the corresponding previous pixel block of the previous video frame; and

if the particular pixel block is not indicated for reconstruction via the corresponding previous pixel block of the previous video frame, then reconstructing the particular pixel block of the non-key video frame based on decoding an encoding of the particular pixel block of the non-key video frame received from the sending device, the encoding of the particular pixel block based on contents of the non-key video frame that contains the particular pixel block and not on contents of the previous key video frame, nor on contents of any other video frame positioned between the previous key video frame and the non-key video frame in the sequence of video frames.

16. The tangible computer-readable storage device of claim 15, wherein said indicating that the particular pixel block is to be reconstructed via the corresponding previous pixel block of the previous video frame, and said indicating that the particular pixel block is to not be reconstructed via the corresponding previous pixel block of the previous video frame, are received from the sending device.

17. The tangible computer-readable storage device of claim 15, wherein the encoding of the particular pixel block of the non-key video frame received from the sending device is based on a singular value decomposition, at the sending device, of a matrix of pixel values for the particular pixel block.

18. The tangible computer-readable storage device of claim 17, wherein the encoding of the particular pixel block of the non-key video frame received from the sending device is an encoding of an approximation matrix that approximates the matrix of pixel values for the particular pixel block based on discarding one or more nonzero singular values obtained in the singular value decomposition, wherein the rank of the approximation matrix is less than the rank of the matrix of pixel values for the particular pixel block.

19. The tangible computer-readable storage device of claim 15, wherein the sending device is mobile computing device.

20. The tangible computer-readable storage device of claim 15, wherein said reconstructing the sequence of video frames is performed by a server which:

encodes the reconstructed sequence of video frames; and

sends the encoding of the reconstructed sequence of video frames to a third device, wherein the third device;

is not the sending device and is not the server; and

is configured to decode the encoding of the reconstructed sequence of video frames and to display the reconstructed sequence of video frames.