Videophone and method for a video call

• US 7,404,001 B2
• Filed: 03/27/2002
• Issued: 07/22/2008
• Est. Priority Date: 03/27/2002
• Status: Expired due to Term

• Current Assignee: Ericsson AB (Telefonaktiebolaget LM Ericsson)
• Original Assignee: Ericsson AB (Telefonaktiebolaget LM Ericsson)
• Inventors: Hill, Peter D., Huber, Richard E., Rosen, Brian, Drury, David Markham, Strait, John P., Campbell, Robert Craig
• Primary Examiner(s): Cardone; Jason D
• Assistant Examiner(s): Mirza; Adnan M
• Application Number:
  US10/114,402
• Publication Number:
  US 20070186002A1
• Time in Patent Office: 2,309 Days
• Field of Search: 709/223, 709/231, 709/244, 709/246, 725/119
• US Class Current: 709/231
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2340/0442 Handling or displaying different aspect ratios, or changing the aspect ratio
• CPC Class Codes: G09G 2370/02 Networking aspects
• CPC Class Codes: G09G 2370/10 Use of a protocol of communication by packets in interfaces along the display data pipeline
• CPC Class Codes: G09G 2380/00 Specific applications
• CPC Class Codes: G09G 5/005 Adapting incoming signals to the display format of the display terminal
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A videophone. The videophone can include an imaging mechanism for taking a video picture of a scene. The videophone can include a mechanism for producing a first video stream of the scene and a second video stream of the scene from the video picture and sending the first video stream and the second video stream onto a network at the same time, the producing mechanism in communication with the imaging mechanism. The videophone can include a mechanism for receiving a plurality of video streams of different scenes from a network. The videophone can include a mechanism for displaying the different scenes of the plurality of video streams alongside each other. A method for a video call.

Claims

1. A telecommunications system comprising:

a network; and

a first node, a second node, and at least a third node in communication with each other through the network, the first node sending a first video stream having a frame rate of a live scene at the first node, a second video stream of the live scene at the first node where the second video stream has a lower frame rate than the frame rate of the first video stream and is independent and is different than the first video stream and an audio stream of the live scene at the first node to the second and third nodes as part of a video conference, the second and third nodes playing the audio stream and either the first video stream or the second video stream, the second video stream requiring less resources of the network, the second and third nodes have a display screen and when the second or third nodes display the first video stream, they display the first video stream as a large image across an area of greater than or equal to 20% of the screen, and when the second and third nodes display the second video stream, they display the second video stream as a small image across an area of less than 20% of the screen, the second node sends a first video stream of a live scene at the second node to the first and third nodes as part of the video conference.

2. A system as described in claim 1 wherein the second node sending a first video stream of a live scene at the second node, a second video stream of the live scene at the second node where the second video stream at the second node is different than the first video stream at the second node and an audio stream at the live scene at the second node to the first and third nodes, the first and third nodes playing the audio stream and either the first video stream or the second video stream of the second node.

3. A system as described in claim 2 wherein the first video stream has a frame rate greater than or equal to 25 frames per second and the second video stream has a frame rate less than 25 frames per second.

4. A system as described in claim 3 including a fourth node in communication with the first, second and third nodes through the network, which sends a television video stream of a television channel to the first, second and third nodes;

the first, second and third nodes able to display the television video stream on the screen along side the first video stream.

5. A system as described in claim 3 wherein the second node sends a first video stream of a scene at the second node, a second video stream of the scene at the second node and an audio stream of the scene to the third node;

and wherein the third node has a display controller which controls the image that appears on the screen and which plays each first video stream from each node alongside each other on the screen of a third node.

6. A system as described in claim 5 wherein the network is an Ethernet or ATM network.

7. A system as described in claim 6 wherein the first and second video streams and the audio streams of the first and second nodes are sent over the network for a video conference call, with no conferencing bridge or MCU used for the video conference call.

8. A system as described in claim 7 wherein each node uses ATM point to multipoint streams for the video conference call.

9. A system as described in claim 8 wherein the third node predetermines which of the first or second video streams from the first or second nodes to display.

10. A system as described in claim 9 wherein the third node chooses to display the first video stream from the first or second nodes if a user in the respective scene at the first or second nodes is talking, or the third node has predetermined to display the first video stream of the first or second nodes.

11. A system as described in claim 10 wherein the first video stream of the first and second nodes is in MPEG-2 format when it is sent over the network.

12. A system as described in claim 11 wherein the first and second nodes use continuous P to place the first video stream of the first and second nodes in the MPEG-2 format.

13. A system as described in claim 12 wherein the first and second nodes clip the first video streams of the scene of the first and second nodes, respectively.

14. A system as described in claim 13 wherein the first and second nodes clip the first video stream of their respective scenes by removing a portion of the first video stream that is associated with a location of the respective scene that has no user.

15. A system as described in claim 14 wherein the first and second nodes only send an audio stream of the scene of the first and second nodes, respectively, if there is a noise above a predetermined threshold at the respective scene.

16. A system as described in claim 15 wherein the first node has an automatic presence sensor which determines whether a user is present at the scene at the first node, and produces a presence indicator of whether the user is at the first node, the first node sends the presence indicator to the second and third nodes.

17. A system as described in claim 16 wherein the first node produces an alert signal to alert any user in the scene at the first node that the presence indicator is going to be formed in a predetermined time.

18. A system as described in claim 17 wherein the first node includes an imaging means for taking a video picture of the first scene and producing the first video stream.

19. A system as described in claim 18 including an encoder in communication with the imaging means which compresses and encodes the first video stream into a desired format without frame buffering.

20. A system as described in claim 19 wherein the first node includes a Field Programmable Gate Array in communication with the encoder, which packetizes the first video stream, and also receives the first video stream from the imaging means and produces the second video stream of the first node and packetizes the second video stream.

21. A system as described in claim 20 wherein the first node includes a network interface in communication with the Field Programmable Gate Array and the network and transfers the first video stream of the first node to the network, and receives the first video stream from the second node and sends it to the Field Programmable Gate Array.

22. A system as described in claim 21 wherein the first node includes microphone means for receiving sound from the first scene and producing the audio stream of the first node.

23. A system as described in claim 22 wherein the first node includes speaker means in communication with the network interface for playing the audio stream from the second node.

24. A system as described in claim 23 wherein the first node includes a DSP which packetizes the audio stream of the first node and provides the audio stream to the Field Programmable Gate Array which transfers the audio stream of the first node to the network interface which transfers the audio stream of the first node to the network, and receives the audio stream of the second node from the Field Programmable Gate Array.

25. A system as described in claim 24 wherein the first node includes an audio interface which receives the audio stream of the first node from the microphone means and digitizes it and provides it to the DSP, and converts the audio stream from the second node that it receives from the DSP to an analog form for the speaker means to play.

26. A system as described in claim 25 wherein the network interface time stamps packets of the audio stream and the video stream of the first node before they are sent to the network, and aligns the packets of the video stream and audio stream of the second node that the first node receives by time stamp so when the video stream and audio stream of the second node are played by the first node, the associated sound with the image of the scene of the second node is played.

27. A system as described in claim 26 wherein the first node includes a receive memory in which the first video stream from the second node is received and stored, and a main controller connected to the network interface, the encoder, the Field Programmable Gate Array and the DSP to control them, the main controller instructing the network interface to choose the first video stream of the second node and send it to the receive memory, the main controller decodes and expands the first video stream of the second node stored in the receive memory and sends it to the display controller.

28. A system as described in claim 27 wherein the first node includes an LCD controller connected to the display controller, and the display screen includes a panel display connected to the LCD controller, the LCD controller receives the first video stream of the second node from the display controller and prepares the first video stream of the second node for display on the panel.

29. A system as described in claim 28 including a touch screen on which buttons associated with functions appear, and a touch screen controller connected to the touch screen and the main controller for transferring information regarding buttons which have been touched on the touch screen by a user to the main controller.

30. A system as described in claim 29 wherein the first node includes a decoder for converting the first video stream from the imaging means of the scene of the first node to digital form and providing it to the encoder and the Field Programmable Gate Array, the decoder connected to the Field Programmable Gate Array and the encoder, the decoder also receiving the television video stream and other analog form video streams and converting them to digital form.

31. A system as described in claim 30 wherein the imaging means includes an analog video camera which is in communication with the decoder, a digital video camera which is in communication with the encoder and the Field Programmable Gate Array, or a fire wire camera in communication with the Field Programmable Gate Array, the Field Programmable Gate Array providing any video stream it receives from the fire wire camera to the encoder.

32. A system as described in claim 31 wherein the DSP provides for stereo echo cancellation of the audio stream of the scene of the first node, the encoder provides for the first video stream of the first node to have a resolution of at least 720 by 640 pixels, and the microphone means and the speaker means are full duplex.

33. A system as described in claim 32 wherein the DSP monitors the microphone means for the noise level produced by the speaker means and adjusts the speaker means to maintain a desired noise level.

34. A system as described in claim 33 wherein the main controller recognizes a command by the user to automatically call another user for a video conference, and use the command to announce to the other users that the other user is being requested for the video conference.

35. A system as described in claim 34 wherein the first node has video mail when the first node is not able to accept a video call.

36. A system as described in claim 35 including a server that is in communication with the network and the first node, which receives the video call for the first node when the first node does not receive the video call, stores a video message associated with the video call that the first node does not receive, and sends a video call waiting message to the first node that there is a video message waiting to be shown to the first node.

37. A system as described in claim 36 wherein the first node has a plurality of display panels connected to the display controller, with the images of the first video streams from different nodes being displayed on the panels alongside each other as though the plurality of panels is one continuous panel.

38. A system as described in claim 37 wherein the first node includes a second imaging means for producing the first video stream of the first node having a different view of the scene at the first node than the imaging means.

39. A system as described in claim 38 wherein the main controller sends the second video stream of the first node from the Field Programmable Gate Array to the display controller to be displayed on the panel so the user of the first node can see the scene of the first node on the display panel.

40. A system as described in claim 39 wherein the first video stream has a bit rate greater than or equal to 1.5 Mbits per second and the second video stream has a bit rate less than 1.5 Mbits per second.