Method and apparatus for conferencing with bandwidth control

• US 7,773,581 B2
• Filed: 03/11/2005
• Issued: 08/10/2010
• Est. Priority Date: 03/19/2004
• Status: Active Grant

• Current Assignee: Ericsson AB (Telefonaktiebolaget LM Ericsson)
• Original Assignee: Ericsson AB (Telefonaktiebolaget LM Ericsson)
• Inventors: Punj, Arun, Huber, Richard E.
• Primary Examiner(s): Cho; Hong
• Assistant Examiner(s): Choi; Eunsook
• Application Number:
  US11/078,738
• Publication Number:
  US 20050237952A1
• Time in Patent Office: 1,978 Days
• Field of Search: None
• US Class Current: 370/352
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 47/15 in relation to multipoint traffic arrangements for broadcast or multicast in data networks H04L12/18
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/762 triggered by the network
• CPC Class Codes: H04L 47/781 Centralised allocation of resources
• CPC Class Codes: H04L 47/801 Real time traffic
• CPC Class Codes: H04L 47/806 Broadcast or multicast traffic
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/1104 Session initiation protocol [SIP]
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04M 2201/50 Telephonic communication in combination with video communication
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A telecommunications system for conferencing including a network. The system comprises N nodes in communication with each other through the network, where N is greater than or equal to three and is an integer. Each node of the N nodes able to produce a unique corresponding video stream having a bandwidth and a unique corresponding audio stream having a bandwidth for transmission over the network to other nodes of the N nodes, with each stream'"'"'s bandwidth from each node being dynamically controlled and set at predetermined levels. A method for conferencing in a telecommunications system. A bandwidth manager. A method for controlling bandwidth in a telecommunications network. A telecommunications system for conferencing. Including a network. The system comprises N nodes in communication with each other through the network, where N is greater than or equal to three and is an integer. Each node able to produce at least one unique corresponding video stream and a unique corresponding audio stream for transmission over the network to other nodes of the N nodes. Each node able to selectively receive any stream from any of the other nodes. A videophone. A method for a video call.

Claims

1. A telecommunications system for conferencing comprising:

a network;

N nodes in communication with each other through the network, where N is greater than or equal to three and is an integer, each node of the N nodes able to produce a unique corresponding video stream having a bandwidth and a unique corresponding audio stream having a bandwidth for transmission over the network to other nodes of the N nodes, with each stream'"'"'s bandwidth from each node being dynamically controlled and set at predetermined levels;

wherein each node packetizes the corresponding video stream and the corresponding audio stream by adding header information to each packet which identifies addresses of the other nodes so that each node uses point to multipoint streams to transmit the corresponding video stream and the corresponding audio stream through the network to the other nodes;

wherein there is a first node, a second node, and, at least a third node of the N nodes in communication with each other through the network, the first node sending a first video stream of a scene at the first node, a second video stream of the scene at the first node and an audio stream of the scene at the first node to the second and third nodes, the second and third nodes playing the audio stream and either the first video stream or the second video stream;

wherein the second node sends a first video stream of a scene at the second node, a second video stream of the scene at the second node and an audio stream of the scene at the second node to the third node, where the third node has a display controller which controls the image that appears on the screen and which plays each first video stream from each node alongside each other on the screen of a third node; and

wherein the first and second video streams and the audio streams of the first and second nodes are sent over the network for a video conference call, with no conferencing bridge or multipoint control unit, MCU, used for the video conference call.

2. A system as described in claim 1 including a bandwidth manager in communication with the N nodes through the network which controls the bandwidth of each stream from each node.

3. A telecommunication system as described in claim 2, wherein the bandwidth manager is implemented as a part of a Session Initiation Protocol, SIP, proxy.

4. A telecommunication system as described in claim 2, wherein the bandwidth manager is implemented as a back-to-back Session Initiation Protocol, SIP, user agent.

5. A system as described in claim 1 wherein the first video stream from the first node has a frame rate greater than or equal to 25 frames per second and the second video stream from the first node has a frame rate less than 25 frames per second.

6. A system as described in claim 5 wherein the second and third nodes have a display screen and when the second or third nodes display the first video stream from the first node, they display the first video stream as a large image across an area of greater than or equal to 20% of the screen, and when the second and third nodes display the second video stream from the first node, they display the second video stream as a small image across an area of less than 20% of the screen.

7. A system as described in claim 6 including a fourth node in communication with the first, second and third nodes through the network, which sends a television video stream of a television channel to the first, second and third nodes;

the first, second and third nodes able to display the television video stream on the screen along side the first video stream from the first node.

8. A system as described in claim 1 wherein the network is an Ethernet or ATM network.

9. A system as described in claim 1 wherein each node uses ATM point to multipoint streams for the video conference call.

10. A system as described in claim 9 wherein the third node predetermines which of the first or second video streams from the first or second nodes to display.

11. A system as described in claim 10 wherein the third node chooses to display the first video stream from the first or second nodes if a user in the respective scene at the first or second nodes is talking, or the third node has predetermined to display the first video stream of the first or second nodes.

12. A system as described in claim 11 wherein the first video stream of the first and second nodes is in MPEG-2 format when it is sent over the network.

13. A system as described in claim 12 wherein the first and second nodes use continuous P to place the first video stream of the first and second nodes in the MPEG-2 format.

14. A system as described in claim 13 wherein the first and second nodes clip the first video streams of the scene of the first and second nodes, respectively.

15. A system as described in claim 14 wherein the first and second nodes clip the first video stream of their respective scenes by removing a portion of the first video stream that is associated with a location of the respective scene that has no user.

16. A system as described in claim 15 wherein the first and second nodes only send an audio stream of the scene of the first and second nodes, respectively, if there is a noise above a predetermined threshold at the respective scene.

17. A system as described in claim 16 wherein the first node has an automatic presence sensor which determines whether a user is present at the scene at the first node, and produces a presence indicator of whether the user is at the first node, the first node sends the presence indicator to the second and third nodes.

18. A system as described in claim 17 wherein the first node produces an alert signal to alert any user in the scene at the first node that the presence indicator is going to be formed in a predetermined time.

19. A system as described in claim 18 wherein the first node includes an imaging means for taking a video picture of the first scene and producing the first video stream.

20. A system as described in claim 19 including an encoder in communication with the imaging means which compresses and encodes the first video stream into a desired format without frame buffering.

21. A system as described in claim 20 wherein the first node includes a Field Programmable Gate Array in communication with the encoder, which packetizes the first video stream, and also receives the first video stream from the imaging means and produces the second video stream of the first node and packetizes the second video stream.

22. A system as described in claim 21 wherein the first node includes a network interface in communication with the Field Programmable Gate Array and the network and transfers the first video stream of the first node to the network, and receives the first video stream from the second node and sends it to the Field Programmable Gate Array.

23. A system as described in claim 22 wherein the first node includes microphone means for receiving sound from the first scene and producing the audio stream of the first node.

24. A system as described in claim 23 wherein the first node includes speaker means in communication with the network interface for playing the audio stream from the second node.

25. A system as described in claim 24 wherein the first node includes a DSP which packetizes the audio stream of the first node and provides the audio stream to the Field Programmable Gate Array which transfers the audio stream of the first node to the network interface which transfers the audio stream of the first node to the network, and receives the audio stream of the second node from the Field Programmable Gate Array.

26. A system as described in claim 25 wherein the first node includes an audio interface which receives the audio stream of the first node from the microphone means and digitizes it and provides it to the DSP, and converts the audio stream from the second node that it receives from the DSP to an analog form for the speaker means to play.

27. A system as described in claim 26 wherein the network interface time stamps packets of the audio stream and the video stream of the first node before they are sent to the network, and aligns the packets of the video stream and audio stream of the second node that the first node receives by time stamp so when the video stream and audio stream of the second node are played by the first node, the associated sound with the image of the scene of the second node is played.

28. A system as described in claim 27 wherein the first node includes a receive memory in which the first video stream from the second node is received and stored, and a main controller connected to the network interface, the encoder, the Field Programmable Gate Array and the DSP to control them, the main controller instructing the network interface to choose the first video stream of the second node and send it to the receive memory, the main controller decodes and expands the first video stream of the second node stored in the receive memory and sends it to the display controller.

29. A system as described in claim 28 wherein the first node includes an LCD controller connected to the display controller, and the display screen includes a panel display connected to the LCD controller, the LCD controller receives the first video stream of the second node from the display controller and prepares the first video stream of the second node for display on the panel.

30. A system as described in claim 29 including a touch screen on which buttons associated with functions appear, and a touch screen controller connected to the touch screen and the main controller for transferring information regarding buttons which have been touched on the touch screen by a user to the main controller.

31. A system as described in claim 30 wherein the first node includes a decoder for converting the first video stream from the imaging means of the scene of the first node to digital form and providing it to the encoder and the Field Programmable Gate Array, the decoder connected to the Field Programmable Gate Array and the encoder, the decoder also receiving the television video stream and other analog form video streams and converting them to digital form.

32. A system as described in claim 31 wherein the imaging means includes an analog video camera which is in communication with the decoder, a digital video camera which is in communication with the encoder and the Field Programmable Gate Array, or a fire wire camera in communication with the Field Programmable Gate Array, the Field Programmable Gate Array providing any video stream it receives from the fire wire camera to the encoder.

33. A system as described in claim 32 wherein the DSP provides for stereo echo cancellation of the audio stream of the scene of the first node, the encoder provides for the first video stream of the first node to have a resolution of at least 720 by 640 pixels, and the microphone means and the speaker means are full duplex.

34. A system as described in claim 33 wherein the DSP monitors the microphone means for the noise level produced by the speaker means and adjusts the speaker means to maintain a desired noise level.

35. A system as described in claim 34 wherein the main controller recognizes a command by the user to automatically call another user for a video conference, and use the command to announce to the other users that the other user is being requested for the video conference.

36. A system as described in claim 35 wherein the first node has video mail when the first node is not able to accept a video call.

37. A system as described in claim 36 including a server that is in communication with the network and the first node, which receives the video call for the first node when the first node does not receive the video call, stores a video message associated with the video call that the first node does not receive, and sends a video call waiting message to the first node that there is a video message waiting to be shown to the first node.

38. A system as described in claim 37 wherein the first node has a plurality of display panels connected to the display controller, with the images of the first video streams from different nodes being displayed on the panels alongside each other as though the plurality of panels is one continuous panel.

39. A system as described in claim 38 wherein the first node includes a second imaging means for producing the first video stream of the first node having a different view of the scene at the first node than the imaging means.

40. A system as described in claim 39 wherein the main controller sends the second video stream of the first node from the Field Programmable Gate Array to the display controller to be displayed on the panel so the user of the first node can see the scene of the first node on the display panel.

41. A method for conferencing in a telecommunications system comprising the steps of:

producing a unique corresponding video stream having a bandwidth and a unique corresponding audio stream having a bandwidth for transmission over a network by each of N nodes in communication with each other through the network, where N is greater than or equal to three and is an integer, to other nodes of the N nodes;

controlling and setting dynamically at predetermined levels each stream'"'"'s bandwidth from each node; and

packetizing at each node the corresponding video stream and the corresponding audio stream by adding header information to each packet which identifies addresses of the other nodes so that each node uses point to multipoint streams to transmit the corresponding video stream and the corresponding audio stream from each node through the network to the other nodes

wherein there is a first node, a second node, and, at least a third node of the N nodes in communication with each other through the network, the first node sending a first video stream of a scene at the first node, a second video stream of the scene at the first node and an audio stream of the scene at the first node to the second and third nodes, the second and third nodes playing the audio stream and either the first video stream or the second video stream;

wherein the second node sends a first video stream of a scene at the second node, a second video stream of the scene at the second node and an audio stream of the scene at the second node to the third node, where the third node has a display controller which controls the image that appears on the screen and which plays each first video stream from each node alongside each other on the screen of a third node; and

wherein the first and second video streams and the audio streams of the first and second nodes are sent over the network for a video conference call, with no conferencing bridge or multipoint control unit, MCU, used for the video conference call.