Object oriented video merging system

• US 6,738,356 B1
• Filed: 08/10/2000
• Issued: 05/18/2004
• Est. Priority Date: 08/10/2000
• Status: Active Grant

• Current Assignee: Radisys Corporation (Reliance Industries Limited)
• Original Assignee: Convedia Corp. (Reliance Industries Limited)
• Inventors: Wu, Wai Ho, Russell, Paul Robert, Geofroy, Paul Joseph
• Primary Examiner(s): NGUYEN, BRIAN D
• Application Number:
  US09/635,633
• Time in Patent Office: 1,377 Days
• Field of Search: 370/260, 370/261, 370/262, 370/263, 370/264, 370/265, 370/266, 370/401, 370/402, 370/470, 370/489, 370/490, 370/503, 370/509, 370/510, 370/512, 370/522, 370/528, 370/527, 370/442, 370/444, 370/537, 370/538, 370/540, 348/14.08, 348/14.09, 348/14.1, 348/14.11, 348/14.12, 348/14.13, 709/204, 709/205, 709/207, 725/109, 725/119
• US Class Current: 370/260
• CPC Class Codes: G06T 9/20 Contour coding, e.g. using detection of edges
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

In an object oriented video merging system for use in teleconferencing, at least an object from one discrete video stream is to be merged into a composite video output signal for return to a plurality of selected sources at each instant in time, and each object in each video frame is describable by a polynomial which defines a two-dimensional shape. Video processing units processing video data from a plurality of video sources on a frame-by-frame basis, and a backplane having at least a data bus, and a common video bus into which an object from one discrete video stream is merged at any instant in time from a respective video processing unit. Each video processing unit includes an object description generator, a video priority register, and a video selector for permitting an object from the video stream being processed by the respective video processor unit to be transmitted to the common video bus only if the priority of that video stream at any instant in time permits such transmission.

Claims

1. An object oriented video merging system for use in teleconferencing, where a plurality of video objects are contained within the active video frames of a plurality of video stream from a plurality of different sources, at any instant in time, where at least an object from one discrete video stream is to be merged into a composite video output signal for return to a plurality of selected sources at each instant in time, and where each object in each video frame is describable by polynomials which define two-dimensional shapes;

said system comprising;

a system controller;

clock means for generating a clock pulse stream;

a plurality of video processing units for periodically processing video data from a plurality of video sources;

frame synchronization means for ensuring synchronization of video frames in each said video processing unit;

a common video bus into which an object from one discrete video stream is merged at any instant in time from a respective video processing unit communicating therewith;

an object description generator for each video stream being processing by each respective video processor;

a video priority determinator in said system controller for determining the priority of each video stream at each instant in time;

video selector means in each video processing unit for permitting an object from the video stream being processed by the respective video processing unit to be transmitted to said common video bus only if the priority of that video stream at any instant in time permits such transmission.

2. The object oriented video merging system of claim 1, wherein said fine synchronization means comprises a master frame pulse generating means for periodically imposing a master frame pulse on said clock pulse stream.

3. The object oriented video merging system of claim 2, wherein said video data is processed by said plurality of video processing units on a fame-by-frame basis.

4. The object oriented video merging system of claim 2, further comprising a backplane having at least a data bus and said common video bus.

5. The object oriented video merging system of claim 4, wherein mutually exclusive predetermined time slots in the blanking interval between active video frames for each video stream being processed by each respective video processing unit are assigned to each respective video processing unit, whereby the object description for the object in each video frame, as generated by the respective object description generator, is broadcast to all video processing units for detection and handling by the respective video selector in each video processing unit during the blanking interval.

6. The object oriented video merging system of claim 5, wherein said predetermined time slots for each respective video processing unit are under the control of said system controller.

7. The object oriented video merging system of claim 5, wherein said predetermined time slots for each respective video processing unit are hard wired into each respective video processing unit.

8. The object oriented video merging system of claim 4, wherein only a single video processor unit will pass a video object signal to the common video bus during any active video time slot, and wherein the video object signal having the highest priority at that instant in time when there is an active video time slot is the video object signal which is passed to the common video bus.

9. The object oriented video merging system of claim 4, wherein said master frame pulse generating means is included in a single designated video processing unit, the selection of which is under the control of said system controller.

10. An object oriented video merging system for use in teleconferencing, where a plurality of video objects are contained within the active video frames of a plurality of video stream from a plurality of different sources, at any instant in time, where at least an object from one discrete video stream is to be merged into a composite video output signal at each instant in time;

and where each object in each video frame is describable by polynomials which define two-dimensional shapes;

said system comprising;

system controller;

a pulse generator for generating a master name pulse;

a clock for generating a stream of clock pulses, over one of which the master frame pulse is periodically imposed;

a plurality of video processing units for processing video data from a plurality of video sources on a video frame by video frame basis; and

a backplane comprising at least a data bus, a clock bus, and a common video bus with which each of said plurality of video processing units communicates;

wherein each said video processing unit comprises a video processor, an object description generator;

a video priority register for receiving and storing data received from said system controller for priority of an object contained in a video frame being processed by the respective video processing unit at each instant in time;

a descriptor/video time division multiplexing controller for controlling a multiplexer to pass either video frame data or object description and video priority data from the video processor or the object description generator and priority register respectively, at any instant in time, and a video selector for collecting data from the backplane to determine if the video frame being processed by the respective video processing unit at that instant in time can be released to the common video bus.

11. The object oriented video merging system of claim 10, wherein mutually exclusive predetermined time slots in the blanking interval between active video frames for each video stream being processed by each respective video processing unit are assigned to each respective video processing unit, whereby the object description for the object in each video frame, as generated by the respective object description generator, is broadcast to all video processing units for detection and handling by the respective video selector in each video processing unit during the blanking interval.

12. The object oriented video merging system of claim 11, wherein the predetermined time slots for each respective video processing unit are under the control of said system controller.

13. The object oriented video merging system of claim 11, wherein the predetermined time slots for each respective video processing unit are hard wired into each respective video processing unit.

14. The object oriented video merging system of claim 10, wherein the multiplexer in each respective video processing unit is under the control of the descriptor/video time division multiplexing controller so as to pass signals from the object description generator to the respective data bus on the backplane, during the blanking intervals between active video frames of the respective video stream being processed by each respective video processing unit.

15. The object oriented video merging system of claim 10, wherein only a single video processing unit will pass a video object signal to the common video bus during any active video time slot, and wherein the video object signal having the highest priority at that instant in time when there is an active video time slot is the video object signal which is passed to the common video bus.

16. The object oriented video merging system of claim 10, wherein said pulse generator is included in a single designated video processing unit, the selection of which is under the control of said system controller.