Video display apparatus and operating method thereof

• US 9,848,230 B2
• Filed: 02/19/2014
• Issued: 12/19/2017
• Est. Priority Date: 02/21/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: An, Seungjoo, Oh, Sejin, Moon, Kyoungsoo, Lee, Jinwon, Kim, Jinpil, Kang, Donghyun, Bae, Jang Hun
• Primary Examiner(s): Mendoza, Junior
• Assistant Examiner(s): Bantamoi, Anthony
• Application Number:
  US14/362,832
• Publication Number:
  US 20150222949A1
• Time in Patent Office: 1,399 Days
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/254 Management at additional data server, e.g. shopping server, rights management server arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467

Abstract

A video display device is provided. A receiving unit obtains an uncompressed audio and video content. A display unit displays the uncompressed audio and video content. A content recognition configuration management unit extracts a first characteristic information corresponding to a first characteristic information type from the uncompressed audio and video content, receives a first response to a first query which includes the first characteristic information, determines a second characteristic information type based on the first response, extracts a second characteristic information corresponding to the second characteristic information type from the uncompressed audio and video content, and receives a second response to a second query which includes the second characteristic information.

Claims

1. An operating method of a video display device including a display, the operating method comprising:

obtaining an uncompressed content including audio data or video data;

extracting first fingerprint information from the uncompressed content according to a default type, wherein the first fingerprint information is a video frame or an audio sample;

receiving a first response including first content information for recognizing the uncompressed content, based on the first fingerprint information, from a first server,

wherein the first content information includes a first content identifier, and

wherein the first content identifier is used for determining a genre of the uncompressed content;

transmitting a first query based on the first content identifier to a second server,

wherein the second server determines recommendation type information on the uncompressed content based on the genre of the uncompressed content;

obtaining the recommendation type information based on the first query, wherein the recommendation type information indicates an audio type or a video type;

determining a first type of second fingerprint information to be extracted from the uncompressed content according to the recommendation type information;

extracting the second fingerprint information from the uncompressed content according to the first type; and

receiving a second response to a second query which includes the second fingerprint information, wherein the second response includes second content information,

wherein the second content information includes identifier information on the uncompressed content, identification information on a content provider, time information of a content section used in the second content information acquisition, name of a channel which the uncompressed content is broadcasted, a logo of a channel which the uncompressed content is broadcasted, a description of a channel which the uncompressed content is broadcasted, a usage information reporting period, a minimum usage time for usage information acquisition, and an available enhanced service information for the uncompressed content,

wherein the determining the first type of the second fingerprint information comprises determining a second type of the second fingerprint information, when the video display device cannot extract the second fingerprint information according to the recommendation type information because of hardware restriction of the video display device,

wherein the second type is different from the first type,

wherein the extracting the first fingerprint information according to the default type comprises;

extracting the first fingerprint information from the audio data, when the default type indicates the audio type, or extracting the first fingerprint information from the video data, when the default type indicates the video type,

wherein the extracting the second fingerprint information according to the first type comprises;

extracting an audio fingerprint information from the audio data, when the first type of the second fingerprint information indicates the audio type, or extracting a video fingerprint information from the video data, when the first type of the second fingerprint information indicates the video type, and

wherein a time point at which the first fingerprint information is extracted is different from a time point at which the second fingerprint information is extracted.

2. The operating method of claim 1, wherein the first content information includes an accuracy of recognition, and

wherein the first type of the second fingerprint information is determined based on the accuracy of the recognition.

3. The operating method of claim 2, wherein the determining the first type of the second fingerprint information based on the accuracy of the recognition comprises determining the first type of the second fingerprint information based on whether the accuracy of the recognition is larger than a predetermined reference value.

4. The operating method of claim 1, wherein the first content information includes information of a sampling window,

wherein the information of the sampling window is a region for extracting the second fingerprint information,

wherein the region does not include a subtitle location, and

wherein the first type of the second fingerprint information is determined based on the information of the sampling window.

5. A video display device, comprising:

a receiver to obtain an uncompressed content including audio data or video data;

a display to display the uncompressed content; and

a content recognition configuration manager to;

extract first fingerprint information from the uncompressed content according to a default type, wherein the first fingerprint information is a video frame or an audio sample,

receive a first response including first content information for recognizing the uncompressed content, based on the first fingerprint information, from a first server,

wherein the first content information includes a first content identifier being used for the determining a genre of the uncompressed content,

transmit a first query based on the first content identifier to a second server,

wherein the second server determines recommendation type information on the uncompressed content based on the genre of the uncompressed content,

obtain the recommendation type information based on the first query, wherein the recommendation type information indicates at least one of an audio type or a video type,

determine a first type of second fingerprint information to be extracted from the uncompressed content according to the recommendation type information,

extract the second fingerprint information from the uncompressed content according to the first type, and

receive a second response to a second query which includes the second fingerprint information, wherein the second response includes second content information,

wherein the second content information includes identifier information on the uncompressed content, identification information on a content provider, time information of a content section used in the second content information acquisition, a name of a channel which the uncompressed content is broadcasted, a logo of a channel which the uncompressed content is broadcasted, a description of a channel which the uncompressed content is broadcasted, a usage information reporting period, a minimum usage time for usage information acquisition, and an available enhanced service information for the uncompressed content,

wherein the determining the first type of the second fingerprint information includes determining a second type of the second fingerprint information, when the video display device cannot extract the second fingerprint information according to the recommendation type information because of hardware restriction of the video display device,

wherein the second type is different from the first type,

wherein the extracting the second fingerprint information according to the first type includes extracting the first fingerprint information from the audio data, when the default type indicates the audio type, or extracting the first fingerprint information from the video data, when the default type indicates the video type,

wherein the extracting the second fingerprint information according to the first type includes extracting an audio fingerprint information from the audio data, when the first type of the first fingerprint information indicates the audio type, or extracting a video fingerprint information from the video data, when the first type of the first fingerprint information indicates the video type, and

wherein a time point at which the first fingerprint information is extracted is different from a time point at which the second fingerprint information is extracted.

6. The video display device of claim 5, wherein the first content information includes an accuracy of recognition, and

wherein the content recognition configuration manager determines the first type of the second fingerprint information based on the accuracy of the recognition.

7. The video display device of claim 6, wherein the content recognition configuration manager determines the first type of the second fingerprint information based on whether the accuracy of the recognition is larger than a predetermined reference value.

8. The video display device of claim 5, wherein the first content information includes an information of a sampling window,

wherein the information of the sampling window is a region for extracting the second fingerprint information,

wherein the region does not include a subtitle location, and

wherein the content recognition configuration manager determines the first type of the second fingerprint information based on the information of the sampling window.