Apparatus and method for processing an interactive service

• US 9,398,341 B2
• Filed: 02/25/2015
• Issued: 07/19/2016
• Est. Priority Date: 09/12/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Oh, Sejin, Kim, Jinpil, An, Seungjoo, Lee, Jinwon, Kim, Kyungho, Moon, Kyoungsoo
• Primary Examiner(s): Alata, Yassin
• Application Number:
  US14/631,447
• Publication Number:
  US 20150172782A1
• Time in Patent Office: 510 Days
• Field of Search: 725 23- 24, 725 32- 36, 725 60- 61
• US Class Current: 1/1
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

A method of processing an interactive service and an apparatus thereof are disclosed. The present invention includes receiving uncompressed audio content or uncompressed video content from an external decoding unit, extracting identifiers of frames from the received content periodically, submitting requests containing the identifiers and receiving a trigger for the content when a new segment is detected or when an event activation needs to be communicated to the receiver, wherein the trigger indicates the current time of the contents and references a particular interactive event in an application parameter table or signals that the event is to be executed now or at a specified future time, wherein the application parameter table includes information about at least one of applications.

Claims

1. A display device for processing an interactive service, the display device comprising:

a receiving module to receive an uncompressed audio content or an uncompressed video content from an external decoding unit;

a signature extraction module to extract signatures from frames of the received content;

a network interface to send the extracted signatures to an ACR (Auto Content Recognition) server, to be checked against a database of signatures of frames in order to recognize the frames represented by the signatures, wherein the frames represented by the signatures are identified by the ACR server,

wherein the network interface receives a time base trigger from the ACR server, wherein the type of trigger is decided by the ACR server based on the frames represented by the signatures,

wherein the time base trigger establishes a time base for activations of events, wherein the time base is synchronized with the frames,

wherein the network interface retrieves an application parameter table using information in the time base trigger,

wherein the application parameter table includes information about at least one of applications,

wherein the information about at least one of applications include first IDs (identifiers) identifying each of the applications, and information about at least one of the events,

wherein the information about at least one of the events include second IDs identifying each of the events, and information about at least one of data to be used for the corresponding event,

wherein the information about at least one of data include third IDs identifying each of the data,

wherein the network interface receives an activation message table along with the application parameter table,

wherein the activation message table includes activation messages for activating the events at activation times relative to the established time base,

wherein each of the activation messages include first attributes, second attributes, third attributes and timing information,

wherein the first attribute matches the first ID to identify the application targeted by the activation message,

wherein the second attribute matches the second ID to identify the event targeted by the activation message,

wherein the timing information indicates start of time period for the event targeted by the activation message, and wherein the third attribute matches the third ID to identify the data to be used for the event targeted by the activation message;

a display module to output supplementary information related to the content;

an user interface (UI) module to receive signal, related to the supplementary information through a remote controller; and

a web browser module to receive a browser key code from the UI module and the remote controller,

wherein when the supplementary information is related to a service using a network, the browser key code is delivered to a web browser, and

wherein when the supplementary information is related to a currently displayed video, signal corresponding to the currently displayed video is delivered to the display module.

2. The display device of claim 1, wherein the network interface to further receive an activation message table along with the application parameter table,

wherein the activation message table includes activation messages for activating the events at activation times relative to the established time base.

3. The display device of claim 2, wherein each of the activation messages include first attributes, second attributes and timing information,

wherein the first attribute matches the first ID to identify the application targeted by the activation message,

wherein the second attribute matches the second ID to identify the event targeted by the activation message, and

wherein the timing information indicates start of time period for the event targeted by the activation message.

4. The display device of claim 3, wherein the application parameter table further includes third IDs identifying data to be used for the event,

wherein the activation message further includes third attributes, and

wherein the third attribute matches the third ID to identify data to be associated with the event targeted by the activation message.

5. The display device of claim 1, wherein the time is a media time,

wherein the media time is a parameter referencing a point in the playout of a content item.

6. The display device of claim 1, wherein the application is a Declarative Object, a Triggered Declarative Object, a Non-Real Time Declarative Object or an Unbound Declarative Object.

7. The display device of claim 1, the display device further comprising:

an automatic content recognition (ACR) module to automatically recognize broadcast content from an audio decoder and/or a video decoder included in the display device.

8. The display device of claim 1, the display device further comprising a web browser to access the network through the network interface based on the signal related to the supplementary information.

9. The display device of claim 1, further comprising a caption module to process caption text and transmit the processed caption text to a graphic processor for displaying the processed caption text.

10. The display device of claim 1, wherein the supplementary information includes information related to broadcast content to be displayed when the supplementary information is available based on the broadcast content.

11. A method of processing an interactive service in a display device, the method comprising:

receiving by a receiving module an uncompressed audio content or an uncompressed video content from a tuner or a setup box;

extracting by a signature extraction module signatures from frames of the received content;

sending requests containing the signatures of the frames to an ACR (Auto Content Recognition) server to identify the uncompressed content, wherein the frames represented by the signatures are identified by the ACR server by being checked against a database of signatures of frames;

receiving by the network interface a time base trigger for the content from the ACR server, wherein the types of the triggers are decided by the ACR server based on the frames represented by the signatures;

wherein the time base trigger establishes a time base for activations of events, wherein the time base is synchronized with the frames;

retrieving by the network interface an application parameter table using information in the time base trigger,

wherein the application parameter table includes information about at least one of applications,

wherein the information about at least one of applications include first IDs (identifiers) identifying each of the applications, and information about at least one of the events,

wherein the information about at least one of the events include second IDs identifying each of the events, and information about at least one of data to be used for the corresponding event,

wherein the information about at least one of data include third IDs identifying each of the data,

wherein the retrieving an application parameter table further includes,

receiving an activation message table along with the application parameter table,

wherein the activation message table includes activation messages for activating the events at activation times relative to the established time base, wherein each of the activation messages include first attributes, second attributes, third attributes and timing information,

wherein the first attribute matches the first ID to identify the application targeted by the activation message,

wherein the second attribute matches the second ID to identify the event targeted by the activation message,

wherein the timing information indicates start of time period for the event targeted by the activation message, and

wherein the third attribute matches the third ID to identify the data to be used for the event targeted by the activation message;

displaying by a display module supplementary information related to the content;

receiving by a user interface (UI) module signal related to the supplementary information through a remote controller; and

receiving by a web browser module a browser key code from the UI module and the remote controller,

wherein when the supplementary information is related to a service using a network, the browser key code is delivered to a web browser, and

wherein when the supplementary information is related to a currently displayed video, signal corresponding to the currently displayed video is delivered to the display module.

12. The method of claim 11, wherein the retrieving an application parameter table further includes receiving an activation message table along with the application parameter table, wherein the activation message table includes activation messages for activating the events at activation times relative to the established time base.

13. The method of claim 12, wherein each of the activation message include first attributes, second attributes and timing information,

wherein the first attribute matches the first ID to identify the application targeted by the activation message,

wherein the second attribute matches the second ID to identify the event targeted by the activation message, and

wherein the timing information indicates start of time period for the event targeted by the activation message.

14. The method of claim 13, wherein the application parameter table further includes third IDs identifying data to be used for the event,

wherein the activation message further includes third attributes, and

wherein the third attribute matches the third ID to identify data to be associated with the event targeted by the activation message.

15. The method of claim 11, wherein the time is a media time, wherein the media time is a parameter referencing a point in the playout of a content item.

16. The method of claim 11, wherein the application is a Declarative Object, a Triggered Declarative Object, a Non-Real Time Declarative Object or an Unbound Declarative Object.

17. The method of claim 11, wherein an automatic content recognition (ACR) module automatically recognizes broadcast content from an audio decoder and/or a video decoder included in the display device.

18. The method of claim 11, the method further comprising:

accessing by a web browser the network through the network interface based on the signal related to the supplementary information.

19. The method of claim 11, wherein a caption module processes caption text and transmit the processed caption text to a graphic processor for displaying the processed caption text.

20. The method of claim 11, wherein the supplementary information includes information related to broadcast content to be displayed when the supplementary information is available based on the broadcast content.