Apparatus and method for processing an interactive service

• US 9,596,494 B2
• Filed: 02/26/2015
• Issued: 03/14/2017
• Est. Priority Date: 08/22/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Oh, Sejin, Kim, Jinpil, An, Seungjoo, Lee, Jinwon, Kim, Kyungho, Moon, Kyoungsoo
• Primary Examiner(s): Alata, Yassin
• Application Number:
  US14/632,463
• Publication Number:
  US 20150172785A1
• Time in Patent Office: 747 Days
• Field of Search: 725 23- 24, 725 32- 36, 725 60- 61
• US Class Current: 1/1
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

A method of processing an interactive service and an apparatus thereof are disclosed. The present invention includes receiving uncompressed audio contents or uncompressed video contents from an external decoding unit, extracting an identifier of a frame from the received content, sending a request containing the identifier to a server and receiving a trigger for the content from the server based on the request, wherein the trigger indicates the current time of the contents and references a particular interactive event in an application parameter table or signals that the event is to be executed now or at a specified future time and the application parameter table includes information about at least one of applications.

Claims

1. A display device for processing an interactive service, the display device comprising:

a receiving module to receive an uncompressed audio content or an uncompressed video content from a decoding unit;

a signature generating module to generate signatures of frames of the received content periodically;

a network interface to send requests containing the signatures of the frames to an ACR (Auto Content Recognition) server to identify the uncompressed content currently being viewed, wherein the frames represented by the signatures are identified by the ACR server by being checked against a database of signatures of frames;

a display module to output supplementary information related to the content;

an user interface (UI) module to receive signal related to the supplementary information through a remote controller; and

a web browser module to receive a browser key code from the UI module and the remote controller,

wherein the network interface receives triggers for the content from the ACR server, wherein the types of the triggers are decided by the ACR server based on the frames represented by the signatures,

wherein the trigger indicates the current time of the content, or references a particular interactive event in an application parameter table and signals that the event is to be executed now or at a specified future time,

wherein the application parameter table includes at least one of application elements having information about applications,

wherein each of the application elements include first identifiers identifying each of the applications, wherein each of the application elements include at least one of event elements having information about the events, wherein each of the event elements include second identifiers identifying each of the events, wherein each of the event elements include at least one of data elements having information about data to be used for the corresponding event,

wherein each of the data elements include third identifiers identifying each of the data,

wherein the trigger is an activation trigger when an activation for one of the events is due to take place,

wherein the activation trigger sets an activation time for the one of the events,

wherein the activation time is indicated by a timing value term in the activation trigger, relative to a time of a segment,

wherein the activation trigger includes an application term, an event term, and a data term, wherein the application term matches the first identifier to identify the application that the activation is targeting, wherein the event term matches the second identifier to identify the event that the activation is targeting, and wherein the data term matches the third identifier to identify the data to be used for the event that the activation is targeting,

wherein when the supplementary information is related to a service using a network, the browser key code is delivered to a web browser, and

wherein when the supplementary information is related to a currently displayed video, signal corresponding to the currently displayed video is delivered to the display module.

2. The display device of claim 1, wherein the trigger is a time base trigger when no event activation is scheduled to take place before sending a next request, and

wherein the time base trigger is used to maintain a time of a segment.

3. The display device of claim 1, wherein the trigger is an activation trigger when an activation is due to take place,

wherein the activation trigger sets an activation time for the event, and

wherein the activation time is indicated by an timing value term in the activation trigger.

4. The display device of claim 1, wherein the network interface to further download a new application parameter table, unless the apparatus has already retrieved the new application parameter table using URL information delivered with the application parameter table, when the trigger includes an application parameter table identifier which identifies the new application parameter table.

5. The display device of claim 3, wherein the display device applies one of the activation trigger, when the apparatus receives more than one activation trigger for same event activation.

6. The display device of claim 3, wherein the activation trigger is applied as soon as the activation trigger arrives, when the activation trigger is received after the activation time.

7. The display device of claim 1, the display device further comprising an automatic content recognition (ACR) module to automatically recognize broadcast content from an audio decoder and/or a video decoder included in the display device.

8. The display device of claim 1, the display device further comprising a web browser to access the network through the network interface based on the signal related to the supplementary information.

9. The display device of claim 1, further comprising a caption module to process caption text and transmit the processed caption text to a graphic processor for displaying the processed caption text.

10. The display device of claim 1, wherein the supplementary information includes information related to broadcast content to be displayed when the supplementary information is available based on the broadcast content.

11. A method of processing an interactive service in a display device, the method comprising:

receiving by a receiving module an uncompressed audio content or an uncompressed video content from a decoding unit;

generating by a signature generating module signatures of frames of the received content periodically;

sending requests containing the signatures of the frames to an ACR (Auto Content Recognition) server to identify the uncompressed content currently being viewed, wherein the frames represented by the signatures are identified by the ACR server by being checked against a database of signatures of frames;

receiving by the network interface triggers for the content from the ACR server, wherein the types of the triggers are decided by the ACR server based on the frames represented by the signatures;

displaying by a display module supplementary information related to the content;

receiving by an user interface (UI) module signal related to the supplemental information through a remote controller; and

receiving by a web browser module a browser key code from the UI module and the remote controller,

wherein the trigger indicates the current time of the content, or references a particular interactive event in an application parameter table and signals that the event is to be executed now or at a specified future time,

wherein the application parameter table includes at least one of application elements having information about applications,

wherein each of the application elements include first identifiers identifying each of the applications, wherein each of the application elements include at least one of event elements having information about the events,

wherein each of the event elements include second identifiers identifying each of the events, wherein each of the event elements include at least one of data elements having information about data to be used for the corresponding event,

wherein each of the data elements include third identifiers identifying each of the data,

wherein the trigger is an activation trigger when an activation for one of the events is due to take place,

wherein the activation trigger sets an activation time for the one of the events,

wherein the activation time is indicated by a timing value term in the activation trigger, relative to a time of a segment,

wherein the activation trigger includes an application term, an event term, and a data term, wherein the application term matches the first identifier to identify the application that the activation is targeting, wherein the event term matches the second identifier to identify the event that the activation is targeting, and wherein the data term matches the third identifier to identify the data to be used for the event that the activation is targeting,

wherein when the supplementary information is related to a service using a network, the browser key code is delivered to a web browser, and

wherein when the supplementary information is related to a currently displayed video, signal corresponding to the currently displayed video is delivered to the display module.

12. The method of claim 11,

wherein the trigger is a time base trigger when no event activation is scheduled to take place before sending a next request, and

wherein the time base trigger is used to maintain a time of a segment.

13. The method of claim 11,

wherein the trigger is an activation trigger when an activation is due to take place,

wherein the activation trigger sets an activation time for the event, and

wherein the activation time is indicated by an timing value term in the activation trigger.

14. The method of claim 11, the method further comprising:

downloading a new application parameter table, unless the receiver has already retrieved the new application parameter table using URL information delivered with the application parameter table, when the trigger includes an application parameter table identifier which identifies the new application parameter table.

15. The method of claim 13, wherein the receiver applies one of the activation trigger, when the receiver receives more than one activation trigger for same event activation.

16. The method of claim 13, wherein the activation trigger is applied as soon as the activation trigger arrives, when the activation trigger is received after the activation time.

17. The method of claim 11, wherein an automatic content recognition (ACR) module automatically recognizes broadcast content from an audio decoder and/or a video decoder included in the display device.

18. The method of claim 11, the method further comprising:

accessing by a web browser the network through the network interface based on the signal related to the supplementary information.

19. The method of claim 11, wherein a caption module processes caption text and transmit the processed caption text to a graphic processor for displaying the processed caption text.

20. The method of claim 11, wherein the supplementary information includes information related to broadcast content to be displayed when the supplementary information is available based on the broadcast content.