Method and apparatus for playing media stream on web browser

• US 10,412,130 B2
• Filed: 12/29/2016
• Issued: 09/10/2019
• Est. Priority Date: 04/04/2016
• Status: Active Grant

• Current Assignee: Hanwha Vision Company Limited
• Original Assignee: Hanwha Techwin Co., Ltd. (Hanwha Corporation)
• Inventors: Cho, Sung Bong, Kunhi Raman, Sujith, Mathivanan, Yogavanan, Anumolu, Tarak Ramgopal, Aravapalli, Venkateswara Rao
• Primary Examiner(s): Shin, Kyung H
• Application Number:
  US15/393,936
• Publication Number:
  US 20170289214A1
• Time in Patent Office: 985 Days
• CPC Class Codes: H04L 65/1059 End-user terminal functionalities specially adapted for real-time communication
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game

Abstract

A media stream playing apparatus for receiving a media stream transmitted from a media service unit and playing the media stream on a web browser is provided. The media stream playing apparatus includes a transmission module configured to establish a communication connection at a transport layer level with the media service unit, a websocket module configured to establish a websocket connection with the media service unit via a handshake procedure based on the communication connection and transmit or receive websocket packets to or from the media service unit while maintaining the websocket connection, a streaming module configured to receive Real-time Transport Protocol (RTP) packets carried by the websocket packets, a media decoder configured to decode the media stream obtained from the RTP packets to reconstruct video, and an output device configured to display the reconstructed video on a screen by embedding the reconstructed video in the web browser.

Claims

1. A media stream playing apparatus comprising at least one processor to implement:

a transmission module configured to establish a communication connection at a transport layer level with a media service device;

a websocket module configured to establish a websocket connection with the media service device based on the communication connection, and transmit or receive websocket packets to or from the media service device while maintaining the websocket connection;

a streaming module configured to receive Real-time Transport Protocol (RTP) packets carried by the websocket packets; and

a media decoder configured to decode a media stream obtained from the RTP packets to reconstruct video for displaying through a web browser,

wherein the websocket module is configured to, in response to receiving a Real Time Streaming Protocol (RTSP) command from the streaming module, transmit a description command to the media service device, and in response to receiving a subsequent RTSP command, transmit a setup command to the media service device.

2. The media stream playing apparatus of claim 1, wherein, after an RTSP is set up between the streaming module and the media service device based on the setup command from the websocket module to the media service device, the streaming module is further configured to transmit or receive RTSP packets for controlling transmission of the RTP packets to or from the media service device, and

wherein the communication connection established by the transmission module comprises a Transmission Control Protocol (TCP) connection.

3. The media stream playing apparatus of claim 1, wherein the web browser supports an HTML5 standard.

4. The media stream playing apparatus of claim 1, further comprising:

a video renderer configured to perform video processing on the reconstructed video to render the reconstructed video; and

an output device configured to display the rendered video through the web browser.

5. The media stream playing apparatus of claim 1, wherein the streaming module and the media decoder are configured to be implemented by JavaScript without a plug-in program in the web browser.

6. The media stream playing apparatus of claim 5, wherein the media decoder comprises a video decoder and an audio decoder which are implemented by the JavaScript.

7. The media stream playing apparatus of claim 6, wherein the media decoder further comprises an audio encoder configured to encode audio captured by the media stream playing apparatus for two-way audio communication between the media stream playing apparatus and the media service device.

8. The media stream playing apparatus of claim 1, wherein an RTSP is set up between the streaming module and the media service device based on an RTSP response transmitted from the web socket module to a streaming client.

9. The media stream playing apparatus of claim 1, wherein, based on a determination that a plug-in can be installed in a user environment, the web browser provides a web page to receive a user'"'"'s selection whether to install the plug-in.

10. The media stream playing apparatus of claim 9, wherein the media decoder is configured to decode the media stream obtained from the RTP packets carried by the websocket packets in response to receiving the user'"'"'s selection not to install the plug-in.

11. A media service device comprising at least one processor to implement:

a media server configured to convert a real-time live video or stored video into Real-time Transport Protocol (RTP) packets; and

a web server configured to establish a connection with a media stream playing apparatus, and transmit the RTP packets over a websocket protocol to the media stream playing apparatus in response to a request from the media stream playing apparatus,

wherein, prior to transmission of the RTP packets, a Real Time Streaming Protocol (RTSP) is set up between the media service device and the media stream playing apparatus, based on a websocket connection between the media service device and the media stream playing apparatus.

12. The media service device of claim 11, wherein the RTP packets transmitted over the websocket protocol comprise a websocket header, an RTP header, and a media stream.

13. The media service device of claim 11, further comprising a camera module configured to capture the real-time live video, and a media encoder configured to encode the captured video,

wherein the web server is configured to transmit the encoded video in real time to the media stream playing apparatus.

14. The media service device of claim 13, wherein the video encoded by the media encoder is stored for long-term storage, or temporarily stored to support streaming via the media server.

15. The media service device of claim 11, wherein the media server is configured to buffer the captured video, packetize the buffered video, and generate the RTP packets, and

wherein the web server is configured to establish a communication session with the media stream playing apparatus for transmission of the RTP packets, transmit the RTP packets over the websocket protocol to the media stream playing apparatus, and perform transmission controls on the transmitted RTP packets.

16. The media service device of claim 11, wherein the web server is configured to support an HTML5 standard.

17. The media service device of claim 11, further comprising a proxy socket configured to encode communication data transmitted by the media server into websocket packets to be transmitted to the media stream playing apparatus, and decode websocket packets received from the media stream playing apparatus in a data format supported by the media server.

18. The media service device of claim 17, wherein the proxy socket is further configured to relay data transmission and reception between the media server and the web server through a predetermined socket.

19. The media service device of claim 11, wherein the media service device comprises a real-time video camera or a network video recorder,

wherein the media stream playing apparatus comprises a web browser, and

wherein the connection established by the web server comprises a Transmission Control Protocol (TCP) connection and the websocket connection established based on the TCP connection.

20. A media service method comprising:

converting a real-time live video or stored video into Real-time Transport Protocol (RTP) packets;

establishing a connection with a media stream playing apparatus; and

transmitting the RTP packets over a websocket protocol to the media stream playing apparatus in response to a request from the media stream playing apparatus,

wherein, prior to the transmitting the RTP packets, the media service method further comprises performing a Real Time Streaming Protocol (RTSP) setup procedure with the media stream playing apparatus, based on a websocket connection with the media stream playing apparatus.

21. The media service method of claim 20, wherein the RTP packets transmitted over the websocket protocol comprise a websocket header, an RTP header, and a media stream.

22. The media service method of claim 20, further comprising capturing the real-time live video by a camera module, and encoding the captured video,

wherein the transmitting the RTP packets comprises transmitting in real time the encoded video to the media stream playing apparatus by a web server.

23. The media service method of claim 20, wherein the converting the encoded video into RTP packets comprises buffering the captured video, packetizing the buffered video, and generating the RTP packets, and

wherein the transmitting the RTP packets comprises establishing a communication session with the media stream playing apparatus for transmission of the RTP packets, transmitting the RTP packets over the websocket protocol to the media stream playing apparatus, and performing transmission controls on the transmitted RTP packets.