Media transmission method and system based on telepresence

• US 20140139618A1
• Filed: 03/21/2012
• Published: 05/22/2014
• Est. Priority Date: 07/08/2011
• Status: Active Grant

• Current Assignee: Xi'An Zhongxing New Software Co., Ltd. (ZTE Corporation)
• Original Assignee: ZTE Corporation
• Inventors: Ye, Xiaoyang, Sun, Bo
• Granted Patent: US 9,344,475 B2
• Time in Patent Office: Days
• US Class Current: 348/14.09
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A media transmission method based on telepresence is disclosed, comprising: during connection establishment, a master telepresence terminal of a local media transmission system and a remote endpoint perform signaling exchange, to establish a media logical channel between the local media transmission system and the remote endpoint; and transmits the same type of media streams between the local media transmission system and the remote endpoint through a media logical channel or respectively through multiple media logical channels, and receives the same type of media streams through a media logical channel or respectively through multiple media logical channels. A media transmission system based on telepresence is further disclosed correspondingly. Through the disclosure, when a telepresence system of a certain conference site is called, only one number needs to be called, which is easy to operate; moreover, agent information exchange can be performed in the telepresence system, thereby achieving the effect of sound-based localization, solving the problem such as synchronization between streams, and improving user experience.

Claims

1. A media transmission method based on telepresence, wherein a media transmission system comprises a master telepresence terminal and at least one secondary telepresence terminal, the method comprises:

during connection establishment, performing signaling exchange by a master telepresence terminal of a local media transmission system and a remote endpoint, to establish media logical channels between the local media transmission system and the remote endpoint;

the local media transmission system transmitting the same type of media streams to the remote endpoint through a media logical channel or respectively through multiple media logical channels, and receiving the same type of media streams through a media logical channel or respectively through multiple media logical channels from the remote endpoint.

2. The method according to claim 1, wherein,

the establishing media logical channel between the local media transmission system and the remote endpoint is:

respectively establishing media logical channels for transmitting media streams between media transmission modules of each local telepresence terminal and the remote endpoint, and recording corresponding information of each media logical channel and positions of an audio input device and/or a video input device;

the transmitting the same type of media streams respectively through multiple media logical channels from the local media transmission system to the remote endpoint is;

transmitting, by at least the audio input device or video input device, at least captured audio or video data to the media encoding and decoding module of the telepresence terminal at corresponding position for encoding;

respectively encoding, by the media encoding and decoding module of each telepresnece terminal, at least inputted audio or video data, and forwarding the encoded media streams to corresponding media transmission module;

respectively transmitting, by the media transmission module of each telepresence terminal, the encoded media streams to the remote endpoint through the media logical channel corresponding to the type and position of a media source.

3. The method according to claim 1, wherein,

the establishing a media logical channel between the local media transmission system and the remote endpoint is:

respectively establishing media logical channels for receiving media streams between the media transmission module of each local telepresence terminal and the remote endpoint, and recording corresponding information of each media logical channel and positions of at least an audio output device or a video output device;

the receiving the same type of media streams by the local media transmission system from the remote endpoint respectively through multiple media logical channels is;

respectively receiving, by the media transmission module of each telepresence terminal, remote multiple media streams through the established media logical channel, and respectively forwarding the media streams to corresponding media encoding and decoding modules for processing according to a corresponding relationship between positions of the media logical channel and the audio output device or video output device;

respectively decoding, by the media encoding and decoding module of each telepresence terminal, the received media streams, and then outputting the media streams to at least corresponding audio output device or video output device for playing.

4. The method according to claim 1, wherein,

the establishing a media logical channel between the local media transmission system and the remote endpoint is:

establishing multiple media logical channels for transmitting media streams between the media transmission module of the master telepresence terminal and the remote endpoint, and recording corresponding information of each media logical channel and positions of at least an audio input device or a video input device;

the transmitting the same type of media streams between the local media transmission system and the remote endpoint respectively through multiple media logical channels is;

transmitting, by at least the audio input device or video input device, at least captured audio or video data to the media encoding and decoding module of the telepresence terminal at corresponding position;

encoding, by each media encoding and decoding module, at least inputted audio or video data respectively, and forwarding the encoded media streams to the media transmission module of the master telepresence terminal;

respectively transmitting, by the media transmission module of the master telepresence terminal, the media streams encoded by the local media encoding and decoding module to the remote endpoint through the media logical channel corresponding to the type and position of a media source.

5. The method according to claim 1, wherein,

the establishing a media logical channel between the local media transmission system and the remote endpoint is:

establishing multiple media logical channels for receiving media streams between the media transmission module of the master telepresence terminal and the remote endpoint, and recording corresponding information of each media logical channel and positions of at least an audio output device or a video output device;

the receiving the same type of media streams between the local media transmission system and the remote endpoint respectively through multiple media logical channels is;

receiving, by the media transmission module of the master telepresence terminal, remote multiple media streams respectively through each established media logical channel, and respectively forwarding the received media streams to the media encoding and decoding module of corresponding telepresence terminal for processing according to a corresponding relationship between the media logical channel and at least the audio output device or video output device;

decoding, by the media encoding and decoding module of each telepresence terminal, at least the received audio or video streams respectively, and then outputting the streams to at least corresponding audio output device or video output device for playing.

6. The method according to claim 1, wherein,

the establishing a media logical channel between the local media transmission system and the remote endpoint is:

establishing a media logical channel for transmitting media streams for each media type between the media transmission module of the master telepresence terminal and the remote endpoint, and recording media types and positions of at least the local audio input device or the video input device;

the transmitting the same type of media streams between the local media transmission system and the remote endpoint through a media logical channel is;

transmitting, by at least the audio input device or video input device, at least captured audio or video data to the media encoding and decoding module of the telepresence terminal at corresponding position;

encoding, by each media encoding and decoding module, at least inputted audio or video data respectively, and forwarding the encoded media streams to the media transmission module of the master telepresence terminal;

transmitting, by the media transmission module of the master telepresence terminal, the encoded media streams through the media logical channel between the master telepresence terminal and the remote endpoint, corresponding media type and position information are comprised in a header of a media package transmitted.

7. The method according to claim 1, wherein,

the establishing a media logical channel between the local media transmission system and the remote endpoint is:

establishing a media logical channel for receiving media streams for each media type between the media transmission module of the master telepresence terminal and the remote endpoint, and recording media types and positions of at least a local audio output device or video output device;

the receiving the same type of media streams between the local media transmission system and the remote endpoint through a media logical channel is;

receiving, by the media transmission module of the master telepresence terminal, the remote media streams from the media logical channel, and forwarding the media streams to the media encoding and decoding module of corresponding telepresence terminal for processing by analyzing the media type and position information identified by the header of a package;

decoding, by the media encoding and decoding module of each telepresence terminal, at least the received audio or video streams respectively, and then outputting the streams to at least corresponding audio output device or video output device for playing.

8. The method according to claim 1, wherein the media logical channel is distinguished by an IP address and a port number, at least IP addresses or port numbers to which different media logical channels correspond are different.

17. The method according to claim 2, wherein the media logical channel is distinguished by an IP address and a port number, at least IP addresses or port numbers to which different media logical channels correspond are different.

9. A media transmission system based on telepresence, wherein the system comprises a master telepresence terminal and at least one secondary telepresence terminals;

wherein,

the master telepresence terminal is configured to, during connection establishment between the media transmission system and a remote endpoint, perform signaling exchange with the remote endpoint, to establish media logical channels between the media transmission system and the remote endpoint; and

transmit the same type of media streams through an established media logical channel or respectively through multiple media logical channels, and receive the same type of media streams through an established media logical channel or respectively through multiple media logical channels;

the secondary telepresence terminal is configured to transmit and receive media streams through the media logical channel established by the master telepresnece terminal.

10. The system according to claim 9, wherein the system further comprises at least a multi audio input device or video input device, the master telepresence terminal at least comprises:

a signalling processing module, a media encoding and decoding module, a media transmission module, the secondary telepresence terminal at least comprises;

a media encoding and decoding module, and a media transmission module;

wherein,

the signaling processing module is configured to be responsible for signalling exchange and implementing media capability negotiation, to respectively establish the media logical channel for transmitting media streams between the media transmission module of each telepresence terminal and the remote endpoint in the system, and record corresponding information of each media logical channel and positions of at least an audio input device or video input device;

at least the audio input device or the video input device is configured to transmit at least captured audio or video data to the media encoding and decoding module of the telepresence terminal at corresponding position for encoding;

the media encoding and decoding module is configured to encode at least the inputted audio or video data, and forward the encoded media streams to corresponding media transmission module;

the media transmission module is configured to transmit the media streams encoded by the media encoding and decoding module to the remote endpoint through the media logical channel corresponding to the type and position of a media source

11. The system according to claim 9, wherein the system further comprises at least a multi audio output device or video output device, the master telepresence terminal at least comprises:

a signalling processing module, a media encoding and decoding module, a media transmission module, the secondary telepresence terminal at least comprises;

a media encoding and decoding module, and a media transmission module;

wherein,

the signaling processing module is configured to be responsible for signalling exchange and implementing media capability negotiation, to respectively establish the media logical channel for receiving media streams between the media transmission module of each telepresence terminal and the remote endpoint in the system, and record corresponding information of each media logical channel and positions of at least the audio output device or video output device;

the media transmission module is configured to receive remote media streams through the established media logical channel, and respectively forward the media streams to corresponding media encoding and decoding module for processing according to a corresponding information of the media logical channel and positions of the audio output device or the video output device;

the media encoding and decoding module is configured to decode the received media streams, then output the media streams to at least corresponding audio output device or video output device for playing.

12. The system according to claim 9, wherein the system further comprises a multiple audio input device and/or video input device, the master telepresence terminal at least comprises:

a signalling processing module, a media encoding and decoding module, a media transmission module, the secondary telepresence terminal at least comprises;

a media encoding and decoding module, and a media transmission module;

wherein,

the signalling processing module is configured to be responsible for signalling exchange and implementing media capability negotiation, to establish multiple media logical channels for transmitting media streams between the media transmission module of the master telepresence terminal and the remote endpoint, and record corresponding information of each media logical channel and positions of at least the audio input device or the video input device;

at least the audio input device or video input device is configured to transmit at least captured audio or video data to the media encoding and decoding module of the telepresence terminal at corresponding position;

the media encoding and decoding module is configured to encode at least the inputted audio or video data, and forward the encoded media streams to the media transmission module of the master telepresence terminal, wherein the media encoding and decoding module of the secondary telepresence terminal forwards the encoded media streams to the media transmission module of the master telepresence terminal through corresponding media transmission module, the media encoding and decoding module of the master telepresence terminal forwards the encoded media streams directly to the media transmission module of the master telepresence terminal;

the media transmission module of the master telepresence terminal is configured to respectively transmit media streams encoded by each media encoding and decoding module in the system to the remote endpoint through the media logical channel corresponding to the type and position of a media source.

13. The system according to claim 9, wherein the system further comprises at least a multiple audio output device or video output device, the master telepresence terminal at least comprises:

a signalling processing module, a media encoding and decoding module, a media transmission module, the secondary telepresence terminal at least comprises;

a media encoding and decoding module, and a media transmission module;

wherein,

the signaling processing module is configured to be responsible for signalling exchange and implementing media capability negotiation, to establish multiple media logical channels for receiving media streams between the media transmission module of the master telepresence terminal and the remote endpoint, and record corresponding information of each media logical channel and positions of at least the audio output device or the video output device;

the media transmission module of the master telepresence terminal is configured to respectively receive remote multiple media streams through each established media logical channel, and respectively forward the received media streams to the media encoding and decoding module of corresponding telepresence terminal for processing according to a corresponding relationship between the media logical channel and at least the audio output device or video output device, wherein the media streams are forwarded directly to the media encoding and decoding module of the master telepresence terminal, and forwarded to the media encoding and decoding module of the secondary telepresence terminal by corresponding media transmission module;

the media encoding and decoding module is configured to decode at least the received audio or video streams, and then output the streams to at least corresponding audio output device or video output device for playing.

14. The system according to claim 9, wherein the system further comprises at least a multiple audio input device or video input device, the master telepresence terminal at least comprises:

a signalling processing module, a media encoding and decoding module, a media transmission module, the secondary telepresence terminal at least comprises;

a media encoding and decoding module, and a media transmission module;

wherein,

the signaling processing module is configured to be responsible for signalling exchange and implementing media capability negotiation, to establish a media logical channel for transmitting media streams for each media type between the media transmission module of the master telepresence terminal and the remote endpoint, and record media types and positions of at least the local audio input device or video input device;

at least the audio input device or video input device is configured to transmit at least captured audio or video data to the media encoding and decoding module of the telepresence terminal at corresponding position;

the media encoding and decoding module is configured to encode at least inputted audio or video data, the media encoding and decoding module of the master telepresence terminal forwards the encoded media streams to corresponding media transmission module, the media encoding and decoding module of the secondary telepresence terminal forwards the encoded media streams to the media transmission module of the master telepresence terminal by corresponding media transmission module;

the terminal transmission module of the master telepresence terminal is configured to transmit the received encoded media streams through the media logical channel between the master telepresence terminal and the remote endpoint, corresponding media type and position information are included in a header of a media package transmitted.

15. The system according to claim 9, wherein the system further comprises at least a multiple audio output device or video output device, the master telepresence terminal at least comprises:

a signalling processing module, a media encoding and decoding module, a media transmission module, the secondary telepresence terminal at least comprises;

a media encoding and decoding module, and a media transmission module;

wherein,

the signaling processing module is configured to be responsible for signalling exchange and implementing media capability negotiation, to establish a media logical channel for receiving for each media type between the media transmission module of the master telepresence terminal and the remote endpoint, and record media types and positions of at least the local audio output device or video output device;

the media transmission module of the master telepresence terminal is configured to receive remote media streams from the media logical channel, forward the media streams to the media encoding and decoding module of corresponding telepresence terminal for processing by analyzing the media type and position information identified by a header, wherein the media streams are forwarded directly to the media encoding and decoding module of the master telepresence terminal, and forwarded to the media encoding and decoding module of the secondary telepresence terminal by corresponding media transmission module;

the media encoding and decoding module is configured to decode at least received audio or video streams, and then output the streams to at least corresponding audio output device or video output device for playing.

16. The system according to claim 9, wherein the media logical channel is distinguished by an IP address and a port number, at least IP addresses or port numbers to which different media logical channels correspond are different.

18. The system according to claim 10, wherein the media logical channel is distinguished by an IP address and a port number, at least IP addresses or port numbers to which different media logical channels correspond are different.