Video conferencing over IP networks

• US 20170230615A1
• Filed: 04/24/2017
• Published: 08/10/2017
• Est. Priority Date: 08/07/2006
• Status: Active Grant

• Current Assignee: Krush Technologies, LLC
• Original Assignee: Krush Technologies, LLC
• Inventors: Feng, Chang, Pesherov, Sergey
• Granted Patent: US 9,883,139 B2
• Time in Patent Office: Days
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 41/509 wherein the managed service relates to media content delivery, e.g. audio, video or TV
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/2475 for supporting traffic characterised by the type of applications
• CPC Class Codes: H04L 47/38 by adapting coding or compression rate
• CPC Class Codes: H04L 47/56 implementing delay-aware scheduling
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 7/0008 Synchronisation information channels, e.g. clock distribution lines
• CPC Class Codes: H04M 1/2535 adapted for voice communication over an Internet Protocol [IP] network Voice over Internet Protocol (VoIP) network equipment and services H04M7/006; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16
• CPC Class Codes: H04M 3/5307 for recording messages comprising any combination of audio and non-audio components
• CPC Class Codes: H04M 3/5315 where the non-audio components are still images or video still image mailbox systems H04N1/324, intermediate storage of video signals for videophones H04N7/147
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04M 7/0072 Speech codec negotiation H04L65/1069 takes precedence
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A method for communication includes establishing multiple communication links over a packet network between a server and plurality of client computers that are to participate in a video teleconference. The client computers may also create secondary communication links that function similarly to links between the server and client computers. The server receives from the client computers uplink audio packets and uplink video packets, which respectively contain audio and video data captured by each of the client computers. The server determines the optimal bandwidth for each client computer. The server also mixes the audio data from the uplink audio packets so as to create respective streams of mixed audio data for transmission to the client computers and transmits to the client computers downlink audio packets containing the respective streams of mixed audio data. The server relays the video data to the client computers in downlink video packets. The client computers receive and synchronize the video data with the mixed audio data.

Claims

1-62. -62. (canceled)

63. A method comprising:

establishing, by at least one processor of a first computing device, a first communication link over a packet network between a client component of the first computing device and a video communications server;

receiving, by the at least one processor and from the video communications server, instructions for initiating a video teleconference between the first computing device and a second computing device;

establishing, by the at least one processor, a second communication link over the packet network between a server component of the first computing device and the second computing device based on the received instructions;

transmitting, by the at least one processor and during the video teleconference, audio and video packets via the second communication link, wherein the audio and video packets respectively comprise audio and video data; and

transmitting, by the at least one processor and during the video teleconference, synchronization packets via the second communication link, wherein the audio and video packets are synchronized for output of the audio and video data at the second computing device based on synchronization information comprised in the synchronization packets.

64. The method of claim 63, further comprising:

establishing, by the at least one processor, a third communication link over the packet network between the server component of the first computing device and a third computing device, wherein each of the first, second, and third computing devices are enabled to participate in the video teleconference.

65. The method of claim 64, wherein the third communication link is established based on the received instructions, wherein the received instructions comprise instructions for initiating a video teleconference between the first, second, and third computing devices.

66. The method of claim 64, further comprising:

transmitting, by the at least one processor and during the video teleconference, the audio and video packets via the third communication link; and

transmitting, by the at least one processor and during the video teleconference, the synchronization packets via the third communication link, wherein the audio and video packets are synchronized for output of the audio and video data at the third computing device based on the synchronization information.

67. The method of claim 66, further comprising:

selecting, by the at least one processor, a first codec for the second computing device based on the received instructions; and

selecting, by the at least one processor, a second codec for the third computing device based on the received instructions, wherein the first codec is different than the second codec.

68. The method of claim 67, wherein the first codec is used by the second computing device to decode at least one of the audio and video data, and wherein the second codec is used by the third computing device to output at least one of the audio and video data.

69. The method of claim 63, further comprising:

receiving, by the at least one processor via the second communication link, second audio, second video, and second synchronization packets, wherein the second audio and video packets respectively comprise second audio and second video data, and wherein the second audio and second video packets are synchronized for output of the second audio and second video data at the first computing device based on synchronization information comprised in the second synchronization packets.

70. A non-transitory computer-readable medium comprising code that, when executed, causes at least one processor of a first computing device to perform the operations of:

establishing, by the at least one processor, a first communication link over a packet network between a client component of the first computing device and a video communications server;

receiving, by the at least one processor and from the video communications server, instructions for initiating a video teleconference between the first computing device and a second computing device;

establishing, by the at least one processor, a second communication link over the packet network between a server component of the first computing device and the second computing device based on the received instructions;

transmitting, by the at least one processor and during the video teleconference, audio and video packets via the second communication link, wherein the audio and video packets respectively comprise audio and video data; and

transmitting, by the at least one processor and during the video teleconference, synchronization packets via the second communication link, wherein the audio and video packets are synchronized for output of the audio and video data at the second computing device based on synchronization information comprised in the synchronization packets.

71. The non-transitory computer-readable medium of claim 70, further comprising code that, when executed, causes the at least one processor to perform the operations of:

establishing, by the at least one processor, a third communication link over the packet network between the server component of the first computing device and a third computing device, wherein each of the first, second, and third computing devices are enabled to participate in the video teleconference.

72. The non-transitory computer-readable medium of claim 71, wherein the third communication link is established based on the received instructions, wherein the received instructions comprise instructions for initiating a video teleconference between the first, second, and third computing devices.

73. The non-transitory computer-readable medium of claim 71, further comprising code that, when executed, causes the at least one processor to perform the operations of:

transmitting, by the at least one processor and during the video teleconference, the audio and video packets via the third communication link; and

transmitting, by the at least one processor and during the video teleconference, the synchronization packets via the third communication link, wherein the audio and video packets are synchronized for output of the audio and video data at the third computing device based on the synchronization information.

74. The non-transitory computer-readable medium of claim 73, further comprising code that, when executed, causes the at least one processor to perform the operations of:

selecting, by the at least one processor, a first codec for the second computing device based on the received instructions; and

selecting, by the at least one processor, a second codec for the third computing device based on the received instructions, wherein the first codec is different than the second codec.

75. The non-transitory computer-readable medium of claim 74, wherein the first codec is used by the second computing device to decode at least one of the audio and video data, and wherein the second codec is used by the third computing device to output at least one of the audio and video data.

76. The non-transitory computer-readable medium of claim 70, further comprising code that, when executed, causes the at least one processor to perform the operations of:

receiving, by the at least one processor via the second communication link, second audio, second video, and second synchronization packets, wherein the second audio and video packets respectively comprise second audio and second video data, and wherein the second audio and second video packets are synchronized for output of the second audio and second video data at the first computing device based on synchronization information comprised in the second synchronization packets.

77. A first computing device comprising:

at least one memory comprising instructions; and

at least one processor configured to execute the instructions, wherein executing the instructions causes the at least one processor to perform the operations of;

establishing, by the at least one processor, a first communication link over a packet network between a client component of the first computing device and a video communications server;

receiving, by the at least one processor and from the video communications server, instructions for initiating a video teleconference between the first computing device and a second computing device;

establishing, by the at least one processor, a second communication link over the packet network between a server component of the first computing device and the second computing device based on the received instructions;

transmitting, by the at least one processor and during the video teleconference, audio and video packets via the second communication link, wherein the audio and video packets respectively comprise audio and video data; and

transmitting, by the at least one processor and during the video teleconference, synchronization packets via the second communication link, wherein the audio and video packets are synchronized for output of the audio and video data at the second computing device based on synchronization information comprised in the synchronization packets.

78. The first computing device of claim 77, wherein executing the instructions further causes the at least one processor to perform the operations of:

establishing, by the at least one processor, a third communication link over the packet network between the server component of the first computing device and a third computing device, wherein each of the first, second, and third computing devices are enabled to participate in the video teleconference.

79. The first computing device of claim 78, wherein the third communication link is established based on the received instructions, the received instructions comprise instructions for initiating a video teleconference between the first, second, and third computing devices.

80. The first computing device of claim 78, wherein executing the instructions further causes the at least one processor to perform the operations of:

transmitting, by the at least one processor and during the video teleconference, the audio and video packets via the third communication link; and

transmitting, by the at least one processor and during the video teleconference, the synchronization packets via the third communication link, wherein the audio and video packets are synchronized for output of the audio and video data at the third computing device based on the synchronization information.

81. The first computing device of claim 80, wherein executing the instructions further causes the at least one processor to perform the operations of:

selecting, by the at least one processor, a first codec for the second computing device based on the received instructions, wherein the first codec is used by the second computing device to decode at least one of the audio and video data; and

selecting, by the at least one processor, a second codec for the third computing device based on the received instructions, wherein the second codec is used by the third computing device to output at least one of the audio and video data, and wherein the first codec is different than the second codec.

82. The first computing device of claim 77, wherein the video communications server comprises, is, or is comprised in the second computing device, or wherein executing the instructions further causes the at least one processor to perform the operations of:

receiving, by the at least one processor via the second communication link, second audio, second video, and second synchronization packets, wherein the second audio and video packets respectively comprise second audio and second video data, and wherein the second audio and second video packets are synchronized for output of the second audio and second video data at the first computing device based on synchronization information comprised in the second synchronization packets.