Video communication using multiple streams

• US 6,611,530 B1
• Filed: 09/21/1999
• Issued: 08/26/2003
• Est. Priority Date: 09/21/1999
• Status: Expired due to Term

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Apostolopoulos, John G.
• Primary Examiner(s): CANGIALOSI, SALVATORE A
• Application Number:
  US09/400,416
• Time in Patent Office: 1,435 Days
• Field of Search: 370/442, 370/487, 375/240.12, 375/240.14, 348/443, 348/512, 709/246
• US Class Current: 370/442
• CPC Class Codes: H04N 19/39 involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server

Abstract

A video communication system that uses multiple streams to carry digital video. The use of multiple streams ensures that errors in one or more of the multiple streams do not prevent reconstruction of remaining ones of the multiple streams. This enables an error free display of the digital video at a reduced frame rate during the loss of a subset of the streams. In addition, the multiple streams provide past and future frames that may be used to recover lost frames and thereby recover the lost stream.

Claims

1. A video communication system, comprising:

sender having means for generating multiple encoded streams in response to a stream of video frames each encoded stream having a series of encoded frames that depend from a previous encoded frame in the corresponding encoded stream;

receiver having means for reconstructing the stream of video frames in response to the multiple encoded streams such that errors in one or more of the multiple encoded streams do not prevent reconstruction of remaining ones of the multiple encoded streams.

2. The video communication system of claim 1, wherein the means for generating multiple encoded streams comprises:

a set of encoders each corresponding to one of the multiple encoded streams;

means for separating the stream of video frames into a stream of video frames for each encoder.

3. The video communication system of claim 2, wherein the means for reconstructing the stream of video frames comprises:

a set of decoders each for generating a stream of reconstructed video frames in response to one of the multiple encoded streams;

means for merging the streams of reconstructed video frames.

4. The video communication system of claim 1, wherein the receiver further comprises means for recovering a frame lost from one of the multiple encoded streams using one or more decoded frames from remaining ones of the multiple encoded streams.

5. The video communication system of claim 1, wherein the receiver further comprises means for estimating a frame lost from one of the multiple encoded streams using one or more decoded frames from remaining ones of the multiple encoded streams.

6. The video communication system of claim 1, wherein the means for generating multiple encoded streams comprises means for decomposing each video frame into a set of quadrants and means for generating multiple streams for each quadrant.

7. The video communication system of claim 1, wherein the means for generating multiple encoded streams comprises means for adapting the number of the multiple encoded streams to communication conditions between the sender and the receiver.

8. The video communication system of claim 1, wherein the sender further comprises means for recovering a frame lost from one of the multiple encoded streams using one or more decoded frames from remaining ones of the multiple encoded streams.

9. The video communication system of claim 8, wherein the sender further comprises means for encoding the multiple encoded streams in response to the recovered lost frame.

10. A method for video communication, comprising the steps of:

generating multiple encoded streams in response to a stream of video frames each encoded stream having a series of encoded frames that depend from a previous encoded frame in the corresponding encoded stream;

reconstructing the stream of video frames in response to the multiple encoded streams such that errors in one or more of the multiple encoded streams do not prevent reconstruction of remaining ones of the multiple encoded streams.

11. The method of claim 10, wherein the step of generating multiple encoded streams comprises the steps of:

separating the stream of video frames into a stream of video frames for each encoded stream;

encoding each stream of video frames separately.

12. The method of claim 11, wherein the step of reconstructing the stream of video frames comprises the steps of:

generating a stream of reconstructed video frames in response to each of the multiple encoded streams;

merging the streams of reconstructed video frames.

13. The method of claim 10, further comprising the step of recovering a frame lost from one of the multiple encoded streams using one or more decoded frames from remaining ones of the multiple encoded streams.

14. The method of claim 10, further comprising the step of estimating a frame lost from one of the multiple encoded streams using one or more decoded frames from remaining ones of the multiple encoded streams.

15. The method of claim 10, wherein the step of generating multiple encoded streams comprises the steps of decomposing each video frame into a set of quadrants and generating multiple streams for each quadrant.

16. The method of claim 10, wherein the step of generating multiple encoded streams comprises the step of adapting the number of the multiple encoded streams to communication conditions between a sender and a receiver.

17. The method of claim 10, wherein the step of generating multiple encoded streams comprises the steps of determining a recovered frame lost from one of the multiple encoded streams using one or more decoded frames from remaining ones of the multiple encoded streams and encoding the multiple encoded streams in response to the recovered lost frame.