Low data-rate video conference system and method, sender equipment and receiver equipment

• US 20150341565A1
• Filed: 10/25/2013
• Published: 11/26/2015
• Est. Priority Date: 11/23/2012
• Status: Abandoned Application

• Current Assignee: ZTE Corporation
• Original Assignee: ZTE Corporation
• Inventors: Zhang, Kai, Li, Xia, Fu, Xianhui, Xiu, Yan
• Application Number:
  US14/647,259
• Publication Number:
  US 20150341565A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Provided is a low-data-rate video conference method. A sender acquires audio data and video data, forms audio characteristic mapping and video characteristic mapping respectively, acquires a local dynamic image, and transmits the audio data and the local dynamic image to a receiver; and the receiver organizes an audio characteristic and video characteristic, which are extracted from local end audio characteristic mapping and video characteristic mapping, and the received local dynamic image to synthesize the original video data, and plays the audio data. In addition, a low-data-rate video conference data transmission system, sender equipment and receiver equipment are provided. As a result, bandwidths can be saved, and increasing video service conference requirements can be met.

Claims

1. A low-data-rate video conference system, comprising a sender and a receiver, wherein

the sender is configured to acquire audio data and video data, form audio characteristic mapping and video characteristic mapping respectively, acquire a local dynamic image, and transmit the audio data and the local dynamic image to the receiver;

and

the receiver is configured to organize an audio characteristic and a video characteristic, which are extracted from local end audio characteristic mapping and video characteristic mapping, and the local dynamic image to synthesize original video data, and play the audio data.

2. The system according to claim 1, wherein the sender comprises an acquisition unit, a recognition unit, a characteristic mapping unit and a sending unit;

the receiver comprises a receiving unit, a characteristic extraction and comparison unit and a data synthesis and output unit;

wherein the acquisition unit is configured to acquire the audio data and the video data, and send the acquired audio data and video data to the recognition unit;

the recognition unit is configured to recognize an identity of a spokesman, perform voice recognition on the acquired audio data to acquire an audio characteristic, perform image recognition on the acquired video data to acquire a video characteristic and the local dynamic image, and send the audio characteristic, the video characteristic and the local dynamic image to the characteristic mapping unit;

the characteristic mapping unit is configured to query whether the audio characteristic mapping and the video characteristic mapping have existed or not, and if the audio characteristic mapping and the video characteristic mapping are not found, generate audio characteristic mapping and video characteristic mapping respectively according to the audio characteristic and the video characteristic;

the sending unit is configured to send the audio data and the local dynamic image, where the identity of the spokesman being contained in a code of the audio data;

the receiving unit is configured to receive the audio data and the local dynamic image;

the characteristic extraction and comparison unit is configured to extract the identity of the spokesman from the code of the audio data, query about the audio characteristic mapping and video characteristic mapping that have existed already, extract the audio characteristic from the audio characteristic mapping according to the identity of the spokesman, and extract the video characteristic from the video characteristic mapping; and

the data synthesis and output unit is configured to synthesize and restore the original video data using the extracted video characteristic and the local dynamic image, and output the audio data and the original video data according to the audio characteristic.

3. The system according to claim 2, wherein the recognition unit is configured to recognize the identity of the spokesman and a conference number of a conference which the spokesman is attending, and form an identity code by virtue of the identity of the spokesman and the conference number, where an identity characteristic corresponding to the acquired audio data and video data being identified by the identity code or by the identity of the spokesman.

4. The system according to claim 2, wherein the characteristic mapping unit is configured to make a query at the sender or a network database;

to adopt the local end audio characteristic mapping and video characteristic mapping under a condition that the audio characteristic mapping and the video characteristic mapping are found at the sender;

to download the audio characteristic mapping and the video characteristic mapping from the network database to the sender under a condition that the audio characteristic mapping and the video characteristic mapping are found from the network database; and

to locally generate audio characteristic mapping and video characteristic mapping under a condition that the audio characteristic mapping and the video characteristic mapping are not found from the sender or the network database.

5. The system according to claim 2, wherein the audio characteristic mapping consists of the identity of the spokesman and an audio characteristic corresponding to the identity of the spokesman;

or the audio characteristic mapping consists of an identity code and an audio characteristic corresponding to the identity code, where the identity code is formed by the identity of the spokesman and a conference number.

6. The system according to claim 2, wherein the video characteristic mapping consists of the identity of the spokesman and a video characteristic corresponding to the identity of the spokesman;

or the video characteristic mapping consists of an identity code and a video characteristic corresponding to the identity code, wherein the identity code is formed by the identity of the spokesman and a conference number.

7. The system according to claim 1, wherein the local dynamic image comprises at least one kind of trajectory image information in head movement, eyeball movement, gesture and contour movement of a spokesman.

17. The system according to claim 2, wherein the local dynamic image comprises at least one kind of trajectory image information in head movement, eyeball movement, gesture and contour movement of a spokesman.

8. A low-data-rate video conference data transmission method, comprising:

acquiring, by a sender, audio data and video data, forming audio characteristic mapping and video characteristic mapping respectively, acquiring a local dynamic image, and transmitting the audio data and the local dynamic image to a receiver; and

organizing, by the receiver, an audio characteristic and a video characteristic, which are extracted from local end audio characteristic mapping and video characteristic mapping, and the local dynamic image to synthesize original video data, and playing the audio data.

9. The method according to claim 8, wherein the step of forming the audio characteristic mapping comprises:

after an identity of a spokesman is recognized, forming the audio characteristic mapping by taking the identity of the spokesman as an index keyword, wherein the audio characteristic mapping consisting of the identity of the spokesman and an audio characteristic corresponding to the identity of the spokesman;

or

after an identity of a spokesman and a conference number are recognized, forming the audio characteristic mapping by taking the identity of the spokesman and the conference number as a combined index keyword, wherein the audio characteristic mapping consisting of an identity code and an audio characteristic corresponding to the identity code, and the identity code being formed by the identity of the spokesman and the conference number.

10. The method according to claim 8, wherein the step of forming the video characteristic mapping comprises:

after an identity of a spokesman is recognized, forming the video characteristic mapping by taking the identity of the spokesman as an index keyword, wherein the video characteristic mapping consisting of the identity of the spokesman and a video characteristic corresponding to the identity of the spokesman;

or

after an identity of a spokesman and a conference number are recognized, forming the video characteristic mapping by taking the identity of the spokesman and the conference number as a combined index keyword, wherein the video characteristic mapping consisting of an identity code and a video characteristic corresponding to the identity code, and the identity code being formed by the identity of the spokesman and the conference number.

11. The method according to claim 8, before the audio characteristic mapping and the video characteristic mapping are formed, the method further comprising:

making a query at the sender and a network database;

adopting the local end audio characteristic mapping and video characteristic mapping under a condition that the audio characteristic mapping and the video characteristic mapping are found at the sender;

downloading the audio characteristic mapping and the video characteristic mapping from the network database to the sender under a condition that the audio characteristic mapping and the video characteristic mapping are found from the network database; and

locally generating audio characteristic mapping and video characteristic mapping under a condition that the audio characteristic mapping and the video characteristic mapping are not found from the sender or the network database.

12. The method according to claim 8, wherein the local dynamic image comprises at least one kind of trajectory image information in head movement, eyeball movement, gesture and contour movement of the spokesman.

18. The method according to claim 9, wherein the local dynamic image comprises at least one kind of trajectory image information in head movement, eyeball movement, gesture and contour movement of the spokesman.

19. The method according to claim 10, wherein the local dynamic image comprises at least one kind of trajectory image information in head movement, eyeball movement, gesture and contour movement of the spokesman.

20. The method according to claim 11, wherein the local dynamic image comprises at least one kind of trajectory image information in head movement, eyeball movement, gesture and contour movement of the spokesman.

13. Sender equipment for a low-data-rate video conference system, configured to acquire audio data and video data, form audio characteristic mapping and video characteristic mapping respectively, acquire a local dynamic image, and transmit the audio data and the local dynamic image to a receiver.

14. The sender equipment according to claim 13, comprising an acquisition unit, a recognition unit, a characteristic mapping unit and a sending unit, wherein

the acquisition unit is configured to acquire the audio data and the video data, and send the acquired audio data and video data to the recognition unit;

the recognition unit is configured to recognize an identity of a spokesman, perform voice recognition on the acquired audio data to acquire an audio characteristic, perform image recognition on the acquired video data to acquire a video characteristic and the local dynamic image, and send the audio characteristic, the video characteristic and the local dynamic image to the characteristic mapping unit;

the characteristic mapping unit is configured to query whether the audio characteristic mapping and the video characteristic mapping have existed or not, and if the audio characteristic mapping and the video characteristic mapping are not found, generate audio characteristic mapping and video characteristic mapping respectively according to the audio characteristic and the video characteristic; and

the sending unit is configured to send the audio data and the local dynamic image, wherein the identity of the spokesman being contained in a code of the audio data.

15. Receiver equipment for a low-data-rate video conference system, configured to organize a local dynamic image received from a sender and an audio characteristic and a video characteristic which are extracted from local end audio characteristic mapping and video characteristic mapping, to synthesize original video data, and play audio data.

16. The receiver equipment according to claim 15, comprising a receiving unit, a characteristic extraction and comparison unit and a data synthesis and output unit, wherein

the receiving unit is configured to receive the audio data and the local dynamic image;

the characteristic extraction and comparison unit is configured to extract an identity of a spokesman from a code of the audio data, query about the audio characteristic mapping and video characteristic mapping that have existed already, extract the audio characteristic from the audio characteristic mapping according to the identity of the spokesman, and extract the video characteristic from the video characteristic mapping; and

the data synthesis and output unit is configured to synthesize and restore the original video data using the extracted video characteristic and the local dynamic image, and output the audio data and the original video data according to the audio characteristic.