INTERACTIVE ACKNOWLEDGE SYSTEM AND METHOD BASED ON INTERNET COMMUNICATIONS AND STREAMING MEDIA LIVE BROADCAST

• US 20170055041A1
• Filed: 08/22/2014
• Published: 02/23/2017
• Est. Priority Date: 05/07/2014
• Status: Abandoned Application

• Current Assignee: Daxin Zhu
• Original Assignee: Daxin Zhu
• Inventors: Zhu, Daxin
• Application Number:
  US15/308,054
• Publication Number:
  US 20170055041A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04L 65/1104 Session initiation protocol [SIP]
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/234 Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82
• CPC Class Codes: H04N 21/63 Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing real-time session protocols H04L65/1101; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/6583 Acknowledgement

Abstract

This invention discloses an interactive acknowledge system and method based on internet communications and streaming media live broadcast, wherein the interactive acknowledge system based on internet communications and streaming media live broadcast includes: an interactive acknowledge publishing client comprising a streaming media data reading module, an interactive acknowledge editing and initiating module and a publishing module, an interactive acknowledge server comprising an interactive acknowledge delivery processing module, an interactive acknowledge delivery strategy judging module and a client delivery module, and an interactive acknowledge client comprising an interactive acknowledge processing module and an interactive acknowledge display and data collection module. The system edits and delivers interactive acknowledge logic or sends out a real-time interactive acknowledge request, is triggered according to a triggering condition, collects and reports acknowledge data, thus realizing a good interaction with audience. Comparing the delivery time axis with the reporting time axis can better control the delay.

Claims

1. :

An interactive acknowledge system based on internet communications and streaming media live broadcast, comprising;

a data collection and synthesis station (4), and also including;

an interactive acknowledge publishing client (1), an interactive acknowledge server (4) and an interactive acknowledge client (3);

The said interactive acknowledge publishing client (1) comprises;

a streaming media data reading module (11) used to read audio-video signals from the said data collection and synthesis station (4) and the time axis data corresponding to the audio-video signals;

the said interactive acknowledge editing and initiating module (12) is used to define and edit the interactive acknowledge logic for interaction or send a real-time interactive acknowledge request for interaction, and set the said interactive acknowledge logic or the delivery strategy for the real-time interactive acknowledge request;

the said publishing module (13) is used to upload the said interactive acknowledge logic or the said real-time interactive acknowledge request, the delivery strategy and the time axis data to the said interactive acknowledge server (2);

The said interactive acknowledge server (2) includes;

an interactive acknowledge delivery processing module (21), an interactive acknowledge delivery strategy judgement module (22) and a client delivery module (23);

the said interactive acknowledge delivery processing module (21) is used to receive the said interactive acknowledge logic or the real-time interactive acknowledge request and the time axis data uploaded;

the said interactive acknowledge delivery strategy judgement module (22) is used to receive the said delivery strategy uploaded and to verify and judge the delivery strategy;

the client delivery module (23) is used to deliver the said interactive acknowledge logic or the real-time interactive acknowledge request and the time axis data to the interactive acknowledge client (3);

The said interactive acknowledge client (3) includes;

an interactive processing module (31) and an interactive acknowledge display and data collection module (32);

the said interactive acknowledge processing module (31) is used to receive the said interactive acknowledge logic or the real-time acknowledge request, and to trigger the interactive acknowledge logic or the real-time interactive acknowledge request according to the triggering conditions;

the said interactive acknowledge display and data collection module (32) is used to receive the time axis data, collect and process the acknowledge data, and report the said acknowledge data and the time axis data to the said data collection and synthesis station (4).

2. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as defined in claim 1, wherein;

the said interactive acknowledge editing and initiating module (12) defines and edits the interactive acknowledge logic used for interactions or sends out the real-time interactive acknowledge request used for interactions, sets the said interactive acknowledge logic or the delivery strategy for the said real-time interactive acknowledge request, and transmits the said interactive acknowledge logic or the real-time acknowledge request and the delivery strategy to the said publishing module (13) which will upload the said interactive acknowledge logic or the real-time interactive acknowledge request and the delivery strategy to the said interactive acknowledge delivery processing module (21) and the interactive acknowledge delivery strategy judgement module (22);

the said interactive acknowledge delivery strategy judgement module receives the delivery strategy uploaded, verifies and judges the said strategy and send it to the said client delivery module (23) after verification, and the said interactive acknowledge delivery processing module (21) receives the said interactive acknowledge logic or the real-time interactive acknowledge request uploaded and send such interactive acknowledge logic or such real-time acknowledge request received to the said client delivery module (23) which will deliver the said interactive acknowledge logic or the real-time interactive acknowledge request to the said interactive acknowledge client (3) according to the verified delivery strategy;

the said interactive acknowledge processing module (31) receives the said interactive acknowledge logic or the real-time acknowledge request and triggers the said interactive acknowledge logic or the real-time acknowledge request according to the triggering conditions and transmit the acknowledge data to the said interactive acknowledge display and data collection module (32) which is used to receive the time axis data, collect and process acknowledge data and report the said time axis data and the acknowledge data to the said data collection and synthesis station (4).

3. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as defined in claim 1, wherein;

the said interactive acknowledge logic editing and initiating module (12) includes an interactive acknowledge logic editing module (121), and the said interactive acknowledge processing module (31) including an interactive acknowledge logic processing module (131).

The said interactive acknowledge logic editing module (121) predefines and pre-edits the interactive acknowledge logic used for interactions, sets the delivery strategy for the said interactive acknowledge logic and transmits the said interactive acknowledge logic and its delivery strategy to the said publishing module (13), and the said publishing module (13) uploads the said interactive acknowledge logic and its delivery strategy to the said interactive acknowledge server (2);

the said interactive acknowledge delivery strategy judgement module (22) receives the delivery strategy uploaded, verifies and judges the said delivery strategy and send the verified delivery strategy to the said client delivery module (23). The said interactive acknowledge delivery processing module (21) receives the said interactive acknowledge logic uploaded and transmits the said interactive acknowledge logic received to the said client delivery module (23);

the said client delivery module (23) delivers the said interactive acknowledge logic to the said interactive acknowledge logic processing module (311) according to the said delivery strategy verified;

the said interactive acknowledge logic processing module (311) receives the said interactive acknowledge logic and pre-store it;

the said streaming media data reading module (11) reads the audio-video signals and the time axis data corresponding to the audio-video signals and transfers the said time axis data to the said publishing module (13), and the said publishing module (13) transfers the said time axis data to the said interactive acknowledge server (2) which delivers the said time axis data to the said interactive acknowledge logic processing module (311) according to the delivery strategy stored after verification, and the said interactive acknowledge logic processing module (311) triggers the said interactive acknowledge logic according to the time axis data and report the acknowledge data in respect of the said interactive acknowledge logic to the said data collection and synthesis station (4).

4. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as defined in claim 1, wherein;

the said interactive acknowledge logic editing and initiating module (12) includes an real-time interactive acknowledge request initiating module (122), and the said interactive acknowledge processing module (31) includes a real-time interactive acknowledge request processing module (312);

the said real-time interactive acknowledge request initiating module (122) receives and sends the real-time interactive acknowledge request used for the interaction purpose to the said publishing module (13), and the said publishing module (13) upload the real-time interactive acknowledge request received and the delivery strategy to the said interactive acknowledge server (2);

the said interactive acknowledge server (2) receives the real-time interactive acknowledge request and the deliver strategy uploaded, verifies and judges the said delivery strategy and delivers the said real-time interactive acknowledge request to the said real-time interactive acknowledge request processing module (312) according to the said delivery strategy verified;

the said real-time interactive acknowledge request processing module (312) receives and triggers the real-time interactive acknowledge request and reports the acknowledge data in respect of the said real-time interactive acknowledge request to the said data collection and synthesis station (4).

5. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as defined in claim 1, wherein;

the said data collection and synthesis station (4) is used to collect multi-input source data and to output such data after edited, processed and synthetized in a real-time manner together with the time axis data to the said streaming media data reading module (11), or used to deliver the said real-time interactive acknowledge request to the real-time interactive acknowledge request initiating module (122) via SIP protocol.

6. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as defined in claim 5, wherein;

the said data collection and synthesis station (4) includes digital encoding and decoding modules (41, 44), a TS stream editing and synthesis module (42), a private editing and synthesis module (43) and a streaming media publishing module (44). The said digital encoding and decoding module (41) converts audio-video analog signals collected into audio-video digital signals before synthetizing to TS stream signals using the said TS stream editing and synthetizing module (43), following which the digital signals are entered in the digital encoding &

decoding module (44) for re-coding, and the re-coded audio-video signals are output to the said streaming media publishing module (45) for publication.

The said digital collection and synthesis station (4) also includes an audio-video request module (46) used to initiate the real-time interactive acknowledge request.

7. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as defined in any of claims claim 1, wherein;

it includes a streaming publishing client (5) connected sequentially with the data output of the said data collection and synthesis station (4), a streaming server (6) and a streaming player client (7);

The said streaming publishing client (5) is used to read the publishing signals from the said data collection and synthesis station (4), and package and partition the streaming media according to various size, format and system needs;

upload the partitioned streaming and output the corresponding time axis data through HTTP or a private protocol;

The said streaming server (6) combines and store partitioned streaming into streaming segments, and create indexes corresponding to several streaming segment sequences;

deliver the streaming segments and indexes and output the corresponding time axis data;

The said streaming player client (7) is used to download streaming segments according to index sequence for playing;

The said streaming publishing client (5) delivers the audio-video signals and the corresponding time axis data to the said streaming player client (7) for playing through the said streaming server (6), and the said interactive acknowledge publishing client (1) reads and calls the audio-video signals output by the said data collection and synthesis station (4) and the corresponding time axis data which are delivered to the said interactive acknowledge client (3) via the said interactive acknowledge server (2), and then the said interactive acknowledge client (3) activates the interactive acknowledge logic or activates it in a real-time manner according to the preset time axis logic after comparing the streaming play time axis of the said streaming player client (7) with the time axis delivered by the said interactive acknowledge server (2), and the said interactive acknowledge client (3) reports the users'"'"' acknowledge data to the data collection &

synthesis station (4).

13. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as described in claim 2, wherein it further includes;

a streaming publishing client (5) connected sequentially with the data output of the said data collection and synthesis station (4), a streaming server (6) and a streaming player client (7);

The said streaming publishing client (5) is used to read the publishing signals from the said data collection and synthesis station (4), and package and partition the streaming media according to various sizes, format and system needs;

upload the partitioned streaming and output the corresponding time axis data through HTTP or a private protocol;

The said streaming server (6) combines and store partitioned streaming into streaming segments, and create indexes corresponding to several streaming segment sequences;

deliver the streaming segments and indexes and output the corresponding time axis data;

The said streaming player client (7) is used to download streaming segments according to index sequence for playing;

The said streaming publishing client (5) delivers the audio-video signals and the corresponding time axis data to the said streaming player client (7) for playing through the said streaming server (6), and the said interactive acknowledge publishing client (1) reads and calls the audio-video signals output by the said data collection and synthesis station (4) and the corresponding time axis data which are delivered to the said interactive acknowledge client (3) via the said interactive acknowledge server (2), and then the said interactive acknowledge client (3) activates the interactive acknowledge logic or activates it in a real-time manner according to the preset time axis logic after comparing the streaming play time axis of the said streaming player client (7) with the time axis delivered by the said interactive acknowledge server (2), and the said interactive acknowledge client (3) reports the users'"'"' acknowledge data to the data collection &

synthesis station (4).

14. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as described in claim 3, wherein it further includes;

a streaming publishing client (5) connected sequentially with the data output of the said data collection and synthesis station (4), a streaming server (6) and a streaming player client (7);

The said streaming publishing client (5) is used to read the publishing signals from the said data collection and synthesis station (4), and package and partition the streaming media according to various sizes, format and system needs;

upload the partitioned streaming and output the corresponding time axis data through HTTP or a private protocol;

The said streaming server (6) combines and store partitioned streaming into streaming segments, and create indexes corresponding to several streaming segment sequences;

deliver the streaming segments and indexes and output the corresponding time axis data;

The said streaming player client (7) is used to download streaming segments according to index sequence for playing;

The said streaming publishing client (5) delivers the audio-video signals and the corresponding time axis data to the said streaming player client (7) for playing through the said streaming server (6), and the said interactive acknowledge publishing client (1) reads and calls the audio-video signals output by the said data collection and synthesis station (4) and the corresponding time axis data which are delivered to the said interactive acknowledge client (3) via the said interactive acknowledge server (2), and then the said interactive acknowledge client (3) activates the interactive acknowledge logic or activates it in a real-time manner according to the preset time axis logic after comparing the streaming play time axis of the said streaming player client (7) with the time axis delivered by the said interactive acknowledge server (2), and the said interactive acknowledge client (3) reports the users'"'"' acknowledge data to the data collection &

synthesis station (4).

15. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as described in claim 4, wherein it further includes;

a streaming publishing client (5) connected sequentially with the data output of the said data collection and synthesis station (4), a streaming server (6) and a streaming player client (7);

The said streaming publishing client (5) is used to read the publishing signals from the said data collection and synthesis station (4), and package and partition the streaming media according to various sizes, format and system needs;

upload the partitioned streaming and output the corresponding time axis data through HTTP or a private protocol;

The said streaming server (6) combines and store partitioned streaming into streaming segments, and create indexes corresponding to several streaming segment sequences;

deliver the streaming segments and indexes and output the corresponding time axis data;

The said streaming player client (7) is used to download streaming segments according to index sequence for playing;

The said streaming publishing client (5) delivers the audio-video signals and the corresponding time axis data to the said streaming player client (7) for playing through the said streaming server (6), and the said interactive acknowledge publishing client (1) reads and calls the audio-video signals output by the said data collection and synthesis station (4) and the corresponding time axis data which are delivered to the said interactive acknowledge client (3) via the said interactive acknowledge server (2), and then the said interactive acknowledge client (3) activates the interactive acknowledge logic or activates it in a real-time manner according to the preset time axis logic after comparing the streaming play time axis of the said streaming player client (7) with the time axis delivered by the said interactive acknowledge server (2), and the said interactive acknowledge client (3) reports the users'"'"' acknowledge data to the data collection &

synthesis station (4).

16. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as described in claim 5, wherein it further includes;

a streaming publishing client (5) connected sequentially with the data output of the said data collection and synthesis station (4), a streaming server (6) and a streaming player client (7);

The said streaming publishing client (5) is used to read the publishing signals from the said data collection and synthesis station (4), and package and partition the streaming media according to various sizes, format and system needs;

upload the partitioned streaming and output the corresponding time axis data through HTTP or a private protocol;

The said streaming server (6) combines and store partitioned streaming into streaming segments, and create indexes corresponding to several streaming segment sequences;

deliver the streaming segments and indexes and output the corresponding time axis data;

The said streaming player client (7) is used to download streaming segments according to index sequence for playing;

The said streaming publishing client (5) delivers the audio-video signals and the corresponding time axis data to the said streaming player client (7) for playing through the said streaming server (6), and the said interactive acknowledge publishing client (1) reads and calls the audio-video signals output by the said data collection and synthesis station (4) and the corresponding time axis data which are delivered to the said interactive acknowledge client (3) via the said interactive acknowledge server (2), and then the said interactive acknowledge client (3) activates the interactive acknowledge logic or activates it in a real-time manner according to the preset time axis logic after comparing the streaming play time axis of the said streaming player client (7) with the time axis delivered by the said interactive acknowledge server (2), and the said interactive acknowledge client (3) reports the users'"'"' acknowledge data to the data collection &

synthesis station (4).

17. :

An interactive acknowledge system based on internet communications and streaming media live broadcast as described in claim 6, wherein it further includes;

a streaming publishing client (5) connected sequentially with the data output of the said data collection and synthesis station (4), a streaming server (6) and a streaming player client (7);

The said streaming publishing client (5) is used to read the publishing signals from the said data collection and synthesis station (4), and package and partition the streaming media according to various sizes, format and system needs;

upload the partitioned streaming and output the corresponding time axis data through HTTP or a private protocol;

The said streaming server (6) combines and store partitioned streaming into streaming segments, and create indexes corresponding to several streaming segment sequences;

deliver the streaming segments and indexes and output the corresponding time axis data;

The said streaming player client (7) is used to download streaming segments according to index sequence for playing;

The said streaming publishing client (5) delivers the audio-video signals and the corresponding time axis data to the said streaming player client (7) for playing through the said streaming server (6), and the said interactive acknowledge publishing client (1) reads and calls the audio-video signals output by the said data collection and synthesis station (4) and the corresponding time axis data which are delivered to the said interactive acknowledge client (3) via the said interactive acknowledge server (2), and then the said interactive acknowledge client (3) activates the interactive acknowledge logic or activates it in a real-time manner according to the preset time axis logic after comparing the streaming play time axis of the said streaming player client (7) with the time axis delivered by the said interactive acknowledge server (2), and the said interactive acknowledge client (3) reports the users'"'"' acknowledge data to the data collection &

synthesis station (4).

8. :

An interactive acknowledge method based on internet communications and streaming media live broadcast is based on an interactive acknowledge system based on internet communications and streaming media live broadcast, which comprises an interactive acknowledge publishing client (1), an interactive acknowledge server (2) and an interactive acknowledge client (3), wherein;

it includes the following steps;

A;

The said interactive acknowledge publishing client (1) defines and edits the interactive acknowledge logic used for interactions or sends out the real-time interactive acknowledge request used for interactions, sets the said interactive acknowledge logic or the delivery strategy for the said real-time interactive acknowledge request, and transmits the said interactive acknowledge logic or the real-time acknowledge request and the delivery strategy to the said interactive acknowledge server (2);

B;

The interactive acknowledge server (2) receives the said interactive acknowledge logic or the real-time interactive acknowledge request and the deliver strategy, verifies and judges the said delivery strategy and delivers the said interactive acknowledge logic or the said real-time acknowledge request to the said interactive acknowledge client (3) according to the verified delivery strategy;

C;

The interactive acknowledge client (3) receives the said interactive acknowledge logic or the real-time acknowledge request, and trigger the said interactive acknowledge logic or the said real-time interactive acknowledge request according to the triggering conditions, and collects and reports the acknowledge data in respect of the said interactive acknowledge logic or the said real-time interactive acknowledge request.

9. :

An interactive acknowledge method based on internet communications and streaming media live broadcast as described in claim 8, wherein;

the said Steps A-C include;

Step A1;

The interactive acknowledge publishing client (1) predefines and pre-edits the interactive acknowledge logic used for interactions, sets the said the delivery strategy for the said interactive acknowledge logic, and transmits the said interactive acknowledge logic and the delivery strategy to the said interactive acknowledge server (2);

Step B1;

The interactive acknowledge server (2) receives the said interactive acknowledge logic and the deliver strategy, verifies and judges the said delivery strategy and delivers the said interactive acknowledge logic to the said interactive acknowledge client (3) according to the verified delivery strategy;

Step C1;

The interactive acknowledge client (3) receives and pre-store the said interactive acknowledge logic;

the said interactive acknowledge publishing client (1) read the audio-video signals and the time axis data to which the audio-video signals correspond and upload the said time axis data to the interactive acknowledge server (2) which in turn delivers the time axis data to the interactive acknowledge client (3) according to the delivery strategy stored and verified, and the said interactive acknowledge client (3) triggers the said pre-stored interactive acknowledge logic according to the time axis data received, and collects and reports the acknowledge data in respect of the said interactive acknowledge logic.

10. :

An interactive acknowledge method based on internet communications and streaming media live broadcast as described in claim 8, wherein;

the said Steps A-C include;

Step A2;

The interactive acknowledge publishing client (1) receives and sends the real-time interactive acknowledge request used for interactions, and uploads the said real-time interactive acknowledge request and the delivery strategy to the said interactive acknowledge server (2);

Step B2;

The interactive acknowledge server (2) receives the said real-time interactive acknowledge request and the deliver strategy uploaded, verifies and judges the said delivery strategy and delivers the said real-time interactive acknowledge request to the said interactive acknowledge client (3) according to the verified delivery strategy;

Step C2;

The interactive acknowledge client (3) receives and triggers the interactive acknowledge request, collects and reports the acknowledge data in respect to the said real-time interactive acknowledge request.

11. :

An interactive acknowledge method based on internet communications and streaming media live broadcast as described in claim 8, wherein it also includes Step A0 before the said Step A;

collects multi-input source data and outputs such data after edited, processed and synthetized in a real-time manner together with the time axis data to the said interactive acknowledge publishing client (1), or sends the real-time acknowledge request to the said interactive acknowledge publishing client (1) via SIP protocol.

12. :

An interactive acknowledge method based on internet communications and streaming media live broadcast as described in claim 8, wherein it also includes Step D;

collect the reported acknowledge data and the time axis data and compare the time axis data delivered with the time axis data reported to control the time lag.