Method and apparatus for mixing compressed video

• US 7,139,015 B2
• Filed: 01/20/2004
• Issued: 11/21/2006
• Est. Priority Date: 01/20/2004
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Eshkoli, Noam, Gants, Oded
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US10/761,718
• Publication Number:
  US 20050157164A1
• Time in Patent Office: 1,036 Days
• Field of Search: 348 1401- 1409, 348/14.1, 348 1411- 1413, 370/260, 370/261, 370/263
• US Class Current: 348/14.07
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

Disclosed herein is a method and apparatus for mixing compressed video useable in a videoconferencing environment having a plurality of endpoint users. Through the use of the method and apparatus, each endpoint can receive a unique layout displaying some subset of the users at the endpoints. Input streams from each endpoint are uncompressed, resized, and scaled to fit the segment in the layout for particular endpoints, and then encoded (or compressed) by a sub-encoder into a sub-encoded stream according to the compression parameters. Each sub-encoded streams is further encoded and associated with a position in the layout. Different layouts may be sent to different conferees, and different compression standards may be used for each endpoint.

Claims

1. A method for use in composing two or more compressed video input streams into at least one compressed output stream of a composed layout, the method comprising:

converting each one of the two or more compressed video input streams into one or more sub-encoded stream, wherein each one of the sub-encoded streams is associated with a segment in the at least one compressed output stream of the composed layout;

manipulating the one or more sub-encoded streams according to the location of its associated segment in the composed layout of the compressed output stream; and

transferring the manipulated one or more sub-encoded streams as the compressed output stream.

2. The method of claim 1, further comprising:

transferring the one or more sub-encoded streams of each one of the two or more compressed video input streams to a sub-encoded common interface; and

getting from the sub-encoded common interface the one or more sub-encoded streams that are associated with the output stream.

3. The method of claim 1, wherein converting each one of the two or more compressed video input streams into one or more sub-encoded stream further comprises changing the resolution of sub-encoded stream.

4. The method of claim 1, wherein converting each one of the two or more compressed video input streams into one or more sub-encoded stream is independent of the location of the associated segment of the sub-encoded stream in the compressed output stream.

5. The method of claim 1, wherein converting each one of the two or more compressed video input streams into one or more sub-encoded streams is accomplished assuming the associated segment of the sub-encoded stream is located in the top left corner of the composed layout.

6. The method of claim 1, wherein the compressed output stream conforms to the H.264 standard.

7. The method of claim 1, wherein the compressed output stream conforms to the MPEG 4 part 10 standard.

8. The method of claim 1, wherein the one or more sub-encoded streams are not QCIF compliant.

9. The methods of claim 6 or 7, further comprising the step of combining two or more segments into one slice-group.

10. The method of claim 9, wherein the two or more segments that are combined into one slice-group do not share a raster scan line.

11. The method of claim 1, wherein the compressed output stream conforms to a standard selected from a group consisting of H.263, MPEG 1, MPEG 2 and MPEG 4.

12. A method for use in composing sub-encoded video input streams from two or more endpoint into at least one compressed output stream of a composed layout, the method comprising:

receiving the sub-encoded video input streams from two or more endpoints;

associating each one of the two or more sub-encoded video input streams to a segment in the composed layout;

manipulating the received sub-encoded video input streams from two or more endpoint according to the location of its associated segment in the composed layout of the compressed output stream; and

transferring the manipulated two or more sub-encoded streams as the compressed output stream.

13. The method of claim 12, wherein the compressed output stream conforms to a standard selected from a group consisting of H.263, MPEG 1, MPEG 2 and MPEG 4.

14. The method of claim 12, wherein the compressed output stream conforms to the H.264 standard.

15. The method of claim 12, wherein the compressed output stream conforms to the MPEG 4 part 10 standard.

16. The method of claim 12, wherein the one or more sub-encoded streams are not QCIF compliant.

17. A system comprising:

at least two input modules being operative to

receive a compressed input stream; and

deliver one or more sub-encoded streams;

at least one output module being operative to

receive two or more sub-encoded streams; and

deliver a compressed output stream of a composed layout;

wherein the output module manipulates location-dependent information in the sub-encoded stream according to its location in the composed layout.

18. The system of claim 17, wherein the compressed output stream conforms to the H.264 standard.

19. The system of claim 17, wherein the compressed output stream conforms to the MPEG 4 part 10 standard.

20. The system of claim 17, wherein the compressed output stream conforms to a standard selected from a group consisting of H.263, MPEG 1, MPEG 2 and MPEG 4.

21. The system of claim 17, wherein the one or more sub-encoded streams are not QCIF compliant.

22. The system of claim 17, further comprising:

a compressed video common interface; and

a sub-encoded common interface;

wherein the compressed video common interface is operative to carry the compressed input streams and the compressed output stream and wherein the sub-encoded common interface is operative to carry the sub-encoded streams between the input modules and the output module.

23. A method for use in composing two or more compressed video input streams into at least one compressed output stream of a composed layout, the method comprising:

converting each one of the two or more compressed video input streams into two or more sub-encoded stream, wherein each one of the sub-encoded streams is associated with a different sized segment in the at least one compressed output stream of the composed layout;

manipulating the one or more sub-encoded streams according to the location of its associated segment in the composed layout of the compressed output stream; and

transferring the manipulated one or more sub-encoded streams as the compressed output stream.