Systems and methods for live multimedia information collection, presentation, and standardization

• US 10,721,500 B2
• Filed: 10/18/2017
• Issued: 07/21/2020
• Est. Priority Date: 10/31/2016
• Status: Active Grant

• Current Assignee: Beijing Xiaomi Mobile Software Co., Ltd. (Xiaomi Corp.)
• Original Assignee: Beijing Xiaomi Mobile Software Co., Ltd. (Xiaomi Corp.)
• Inventors: Han, Shangyou, Sun, Chao, Yu, Zegao
• Primary Examiner(s): Hong, Michael H
• Application Number:
  US15/787,303
• Publication Number:
  US 20180124435A1
• Time in Patent Office: 1,007 Days
• Field of Search: 725116, 725131, 725 89, 725 34, 725 46, 725 14, 725 19, 725 92, 725 30, 725 24
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/222 Secondary servers, e.g. proxy server, cable television Head-end provisioning of proxy services in data packet switching networks H04L67/56
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The present disclosure relates to presentation of live multimedia information via a live multimedia information system that includes a collecting device, and a standardization server. A live instruction sent by a live terminal is received; ambient information is recorded and multimedia information is obtained using the collecting device; the multimedia information, which may include audiovisual information to be presented in real time to remote viewers, is sent to the standardization server according to the live instruction, which may identify a destination for the multimedia information. The standardization server may send the multimedia information, which may be optimized for one or more playing terminals, to a playing terminal, and the playing terminal may receive and play the multimedia information for a remote audience. Playback quality is improved for live multimedia information.

Claims

1. A method, implemented using a collecting device, for presentation of live multimedia information, the collecting device being part of a live multimedia information system comprising a standardization server, a live terminal, a playing terminal, and the collecting device, wherein the collecting device is configured to send multimedia information to the standardization server, and wherein the standardization server is configured to receive multimedia information from the collecting device and send multimedia information to the playing terminal, the method comprising:

receiving, at the collecting device, a live instruction sent by the live terminal, the live instruction identifying a destination for multimedia information, wherein the destination is identified in the live instruction for the multimedia information using a first network address that is allocated to the live terminal by the standardization server, and the multimedia information is standardized and is stored in a second network address wherein the first network address and the second network address correspond to the live terminal and the collecting device;

recording, via the collecting device, ambient information to obtain multimedia information having audiovisual information to be presented to a remote viewer; and

based on the destination identified in the live instruction, sending the multimedia information from the collecting device to a storage module indicated by the first network address of the standardization server for transmission to the playing terminal, the playing terminal being configured to receive the multimedia information from the standardization server and play the multimedia information for the remote viewer.

2. The method according to claim 1, wherein the multimedia information obtained by the collecting device has a format of high definition multimedia interface (HDMI) or serial digital interface (SDI).

3. The method according to claim 1, wherein sending the multimedia information to the standardization server comprises:

sending the multimedia information to the standardization server based on real time messaging protocol (RTMP).

4. The method according to claim 1, wherein the first network address belongs to at least one network address of the standardization server.

5. A method, implemented using a standardization server, for presentation of live multimedia information, the standardization server being part of a live multimedia information system comprising a collecting device, a live terminal, a playing terminal, and the standardization server, wherein the collecting device is configured to send multimedia information to the standardization server, and wherein the standardization server is configured to receive multimedia information from the collecting device and send multimedia information to the playing terminal, the method comprising:

allocating a first network address and a second network address to the live terminal from at least two network addresses of the standardization server, and sending the first network address to the live terminal, wherein the first network address and the second network address correspond to the live terminal and the collecting device, and the live terminal sends the first network address to the collecting device;

receiving, at the standardization server, multimedia information sent by the collecting device, wherein the multimedia information is obtained by the collecting device by recording ambient information, the multimedia information having audiovisual information to be presented to a remote viewer, and wherein the collecting device sends the multimedia information according to a live instruction received from the live terminal, the live instruction identifying a destination for the multimedia information, the destination being a first network address allocated to the live terminal by the standardization server;

standardizing the multimedia information and caching standardized multimedia information in a storage module indicated by the second network address; and

sending the standardized multimedia information from the standardization server to the playing terminal, wherein the playing terminal is configured to receive and play the multimedia information for the remote viewer, and deleting the standardized multimedia information in the storage module indicated by the second network address.

6. The method according to claim 5, wherein the multimedia information obtained by the collecting device has a format of high definition multimedia interface (HDMI) or serial digital interface (SDI).

7. The method according to claim 5, wherein receiving multimedia information sent by the collecting device comprises:

receiving multimedia information sent by the collecting device based on real time messaging protocol (RTMP).

8. The method according to claim 5, wherein the first network address and the second network address are allocated in response to

receiving, at the standardization server, a live request sent by the live terminal;

and

the first network address and the second network address indicate different storage modules of the standardization server.

9. The method according to claim 8, wherein standardizing the multimedia information comprises:

standardizing the multimedia information to generate standardized multimedia information having live broadcast parameters for the playing terminal;

receiving, from the playing terminal, a playing request carrying the second network address;

wherein sending the standardized multimedia information from the standardization server to the playing terminal comprises;

retrieving the standardized multimedia information from the storage module corresponding to the second network address; and

sending the standardized multimedia information to the playing terminal via a live delivery mechanism and a content delivery network (CDN) mechanism.

10. A collecting device, included in a multimedia information live system, wherein the multimedia information live system further comprises a standardization server, a live terminal, and a playing terminal, and the collecting device comprises:

a receiver, configured to receive a live instruction sent from the live terminal, the live instruction identifying a destination for multimedia information, wherein the destination is identified in the live instruction for the multimedia information using a first network address that is allocated to the live terminal by the standardization server, and the multimedia information is standardized and is stored in a second network address wherein the first network address and the second network address correspond to the live terminal and the collecting device;

a processor, configured to record ambient information to obtain multimedia information having audiovisual information to be presented in real time to a remote viewer;

a transmitter, configured to send the multimedia information to a storage module indicated by the first network address of the standardization server based on the destination identified in the live instruction, wherein the standardization server is configured to send the multimedia information to the playing terminal, and wherein the playing terminal is configured to receive the multimedia information from the standardization server and play the multimedia information for the remote viewer.

11. The collecting device according to claim 10, wherein the multimedia information obtained by the collecting device has a format of high definition multimedia interface (HDMI) or serial digital interface (SDI).

12. The collecting device according to claim 10, wherein the transmitter is further configured to send the multimedia information to the standardization server based on real time messaging protocol (RTMP).

13. The method according to claim 10, wherein the first network address belongs to at least one network address of the standardization server.

14. A standardization server, included in a multimedia information live system, wherein the multimedia information live system further comprises a collecting device, a live terminal, and a playing terminal, and the standardization server comprises:

a processing component;

a memory, configured to store instructions executable by the processing component;

wherein the processing component is configured to execute instructions stored in the memory to;

allocate a first network address and a second network address to the live terminal from at least two network addresses of the standardization server, and sending the first network address to the live terminal, wherein the first network address and the second network address correspond to the live terminal and the collecting device, and the live terminal sends the first network address to the collecting device;

receive multimedia information sent by the collecting device, wherein the multimedia information is sent by the collecting device according to a live instruction that identifies a destination for the multimedia information, wherein the multimedia information is obtained by the collecting device by recording ambient information, wherein the multimedia information includes audiovisual information to be presented in real time to a remote viewer, and wherein the live instruction is sent from the live terminal to the collecting device, the destination being a first network address allocated to the live terminal by the standardization server;

standardize the multimedia information and caching standardized multimedia information in a storage module indicated by the second network address; and

send the standardized multimedia information to the playing terminal, wherein the playing terminal is configured to receive the multimedia information and play the multimedia information for the remote viewer, and delete the standardized multimedia information in the storage module indicated by the second network address.

15. The standardization server according to claim 14, wherein the multimedia information obtained by the collecting device has a format of high definition multimedia interface (HDMI) or serial digital interface (SDI).

16. The standardization server according to claim 14, wherein the processing component is further configured to execute instructions stored in the memory to receive the multimedia information sent by the collecting device according to the live instruction based on real time messaging protocol (RTMP).

17. The standardization server according to claim 14, wherein the first network address and the second network address are allocated in response to:

receiving, at the standardization server, a live request sent from the live terminal; and

the first network address and the second network address indicate different storage modules of the standardization server.

18. The standardization server according to claim 17, wherein the processing component is configured execute instructions stored in the memory to:

standardize the multimedia information to generate standardized multimedia information having live broadcast parameters for the playing terminal; and

receive, from the playing terminal, a playing request carrying the second network address;

wherein the processing component is further configured to send the standardized multimedia information from the standardization server to the playing terminal by;

retrieving the standardized multimedia information from the storage module corresponding to the second network address;

sending the standardized multimedia information to the playing terminal via a live delivery mechanism and a content delivery network (CDN) mechanism.