Video Decoder which Processes Multiple Video Streams

• US 20080316298A1
• Filed: 06/19/2008
• Published: 12/25/2008
• Est. Priority Date: 06/22/2007
• Status: Active Grant

• Current Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Original Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Inventors: King, Keith C., Mock, Wayne E.
• Granted Patent: US 8,633,962 B2
• Time in Patent Office: Days
• US Class Current: 348/14.09
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

In some embodiments, a spatially multiplexed output decoder may spatially multiplex video packets received in a time multiplexed video stream. A video stream with video packets from two or more sources may be received along with metadata. In some embodiments, a decoder may organize the video packets into respective buffers (e.g., each buffer including video packets for a respective video image). The spatially multiplexed output decoder may spatially multiplex the video images (which are made up of data from the respective video packets) into a video frame to be outputted (e.g., to a separate buffer). The video images in the video frame may then be demultiplexed in other parts of the system (e.g., in a virtual decoder) using information provided about the video frame (e.g., in metadata formed with the video frame).

Claims

1. A method, comprising:

receiving a video stream comprising time multiplexed video packets from two or more video sources;

sorting the video packets into buffers according to the video packets respective video source; and

spatially multiplexing video images into a composite video frame, wherein the video images are formed using the video packets from the respective buffers.

2. The method of claim 1, further comprising writing out the composite video frame to a single buffer.

3. The method of claim 1, further comprising receiving metadata with the video stream, wherein the metadata includes identification information and is used to sort the video packets into the respective buffers.

4. The method of claim 1, further comprising generating metadata for the composite video frame, wherein the metadata for the composite video frame includes coordinate information for the video images in the composite video frame.

5. The method claim 4, wherein the metadata further includes identifying information for a video conferencing system corresponding to the coordinate information of the video image.

6. The method of claim 1, wherein the two or more video sources comprise two or more video conferencing endpoints.

7. The method of claim 1, further comprising:

receiving the composite video frame; and

separating the two or more video images into separate video images.

8. The method of claim 7, further comprising:

compositing a new video layout, wherein the new video layout includes at least one separated video image.

9. The method of claim 8, further comprising transmitting the new video layout to a video conferencing endpoint.

10. The method of claim 8, further comprising displaying the new video layout.

12. The ASIC of claim 1, further comprising writing out the composite video frame to a single buffer.

13. The ASIC of claim 1, further comprising receiving metadata with the video stream, wherein the metadata includes identification information and is used to sort the video packets into the respective buffers.

14. The ASIC of claim 1, further comprising generating metadata for the composite video frame, wherein the metadata for the composite video frame includes coordinate information for the video images in the composite video frame.

15. The method claim 4, wherein the metadata further includes identifying information for a video conferencing system corresponding to the coordinate information of the video image.

16. The method of claim 1, wherein the two or more video sources comprise two or more video conferencing endpoints.

11. An application specific integrated circuit (ASIC), wherein the integrated circuit is operable to:

receive a video stream comprising time multiplexed video packets from two or more video sources;

sort the video packets into buffers according to the video packets respective video source; and

spatially multiplex video images into a composite video frame, wherein the video images are formed using the video packets from the respective buffers

17. A method, comprising:

receiving a video stream comprising time multiplexed video packets from two or more video conferencing endpoints;

receiving metadata with the video stream;

wherein the metadata includes identification information for the video packets in the video stream;

sorting the video packets into buffers according to the video packets respective video source, wherein the metadata is used to sort the video packets into the respective buffers; and

spatially multiplexing video images into a composite video frame, wherein the video images are formed using the video packets from the respective buffers.

18. The method of claim 17, further comprising generating metadata for the composite video frame, wherein the metadata for the composite video frame includes coordinate information for the video images in the composite video frame.

19. The method of claim 17, further comprising:

receiving the composite video frame; and

separating the two or more video images into separate video images.

20. The method of claim 19, further comprising:

compositing a new video layout, wherein the new video layout includes at least one separated video image.