Video receiving device, appended information display method, and appended information display system

• US 9,955,103 B2
• Filed: 07/02/2014
• Issued: 04/24/2018
• Est. Priority Date: 07/26/2013
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Yabu, Hiroshi
• Primary Examiner(s): Lee, Michael
• Assistant Examiner(s): Monshi, Samira
• Application Number:
  US14/787,721
• Publication Number:
  US 20160073047A1
• Time in Patent Office: 1,392 Days
• Field of Search: None
• CPC Class Codes: H04N 21/254 Management at additional data server, e.g. shopping server, rights management server arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4886 for displaying a ticker, e.g. scrolling banner for news, stock exchange, weather data
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 5/45 Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen

Abstract

Additional information related to video signals input from an outside is obtained and superimposed on the video signals. Hence, video reception device which is configured to transmit and receive data through communication network includes input unit, video extraction unit, control unit and additional information display control unit. The control unit performs control of requesting video recognition device to perform video recognition processing on a partial video extracted by the video extraction unit, and obtaining additional information based on a result of the video recognition processing from the video recognition device. The additional information display control unit performs control of detecting whether or not a screen layout of video signals has been changed, and superimposing the additional information on the video signals based on a detection result.

Claims

1. A video reception device configured to transmit and receive data through a communication network, the video reception device comprising:

an input unit configured to receive an input of a video signal;

a video extraction unit configured to extract a partial video for video recognition processing, from the video signal;

a control unit configured to perform control of transmitting the partial video to a video recognition device connected to the communication network so as to request the video recognition device to perform the video recognition processing, obtaining a result of the video recognition processing from the video recognition device, and obtaining additional information based on the result of the video recognition processing from an additional information distribution device connected to the communication network;

an additional information display control unit configured to perform control of detecting whether or not a UI (User Interface) image is included in the video signal, and superimposing the additional information on the video signal based on a result of the detection; and

an obtaining unit configured to obtain a template video related to the video signal from the video recognition device,

wherein the additional information display control unit is configured to hide the additional information, which is being displayed on a displaying unit, in response to detecting that the UI image is included in the video signal, and

wherein the additional information display control unit is configured to divide the video signal and the template video into a plurality of regions, compare the template video and the video signal for each of the regions, calculate a similarity for each of the regions, compare the similarity with a threshold value set in advance, determine whether or not a number of regions whose similarities do not exceed the threshold value is equal to or greater than a predetermined number, and detect whether or not the UI image is included in the video signal.

2. The video reception device according to claim 1, further comprising the displaying unit configured to display a video obtained by superimposing the additional information on the video signal.

3. The video reception device according to claim 1, further comprising a storage unit configured to store a template image group including a plurality of template images related to a video transmission device which outputs the video signal,

wherein the additional information display control unit is configured to determine whether or not the template images are included in the video signal by template-matching a search area set to the video signal and each of the template images of the template image group, and detect whether or not the UI image is included in the video signal based on the determination.

4. The video reception device according to claim 1, wherein the additional information display control unit is configured to, when detecting a content switching operation performed on a video transmission device which outputs the video signal, perform control of hiding the additional information which is being displayed on the displaying unit.

5. The video reception device according to claim 1, wherein the additional information display control unit is configured to, when detecting a particular content whose content switch can be detected, perform control of hiding the additional information which is being displayed on the displaying unit.

6. An additional information display method of a video reception device configured to transmit and receive data through a communication network, the additional information display method comprising:

extracting a partial video for video recognition processing, from a video signal input from an outside;

transmitting the partial video to a video recognition device connected to the communication network so as to request the video recognition device to perform the video recognition processing, and obtaining a result of the video recognition processing from the video recognition device;

obtaining additional information based on the result of the video recognition processing, from an additional information distribution device connected to the communication network;

detecting whether or not a UI (User Interface) image is included in the video signal;

performing control of superimposing the additional information on the video signal based on a result of the detection; and

obtaining a template video related to the video signal from the video recognition device,

wherein, in response to detecting that the UI image is included in the video signal, the additional information which is being displayed on a displaying unit is hidden, and

wherein the video signal and the template video are divided into a plurality of regions, the template video and the video signal are compared for each of the regions, a similarity is calculated for each of the regions, the similarity is compared with a threshold value set in advance, whether or not a number of regions whose similarities do not exceed the threshold value is equal to or greater than a predetermined number is determined, and whether or not the UI image is included in the video signal is detected.

7. The additional information display method according to claim 6, further comprising displaying, on the displaying unit, a video obtained by superimposing the additional information on the video signal.

8. The additional information display method according to claim 6, further comprising storing a template image group including a plurality of template images related to a video transmission device which outputs the video signal,

wherein whether or not the template images are included in the video signal is determined by template-matching a search area set to the video signal and each of the template images of the template image group, and whether or not the UI image is included in the video signal is detected based on the determination.

9. The additional information display method according to claim 6, wherein, when a content switching operation performed on a video transmission device which outputs the video signal is detected, the additional information which is being displayed on the displaying unit is hidden.

10. The additional information display method according to claim 6, wherein, when a particular content whose content switch can be detected is detected, the additional information which is being displayed on the displaying unit is hidden.

11. An additional information display system which comprises a video reception device, a video recognition device, and an additional information distribution device, the devices being configured to transmit and receive data to each other through a communication network,

wherein the video reception device includes:

an input unit configured to receive an input of a video signal;

a video extraction unit configured to extract a partial video for video recognition processing, from the video signal;

a control unit configured to perform control of transmitting the partial video to the video recognition device through the communication network so as to request the video recognition device to perform the video recognition processing, obtaining a result of the video recognition processing from the video recognition device through the communication network, and obtaining additional information based on the result of the video recognition processing from the additional information distribution device through the communication network;

an additional information display control unit configured to perform control of detecting whether or not a UI (User Interface) image is included in the video signal, and superimposing the additional information on the video signal based on a result of the detection; and

an obtaining unit configured to obtain a template video related to the video signal from the video recognition device,

wherein the additional information display control unit is configured to hide the additional information, which is being displayed on a displaying unit, in response to detecting that the UI image is included in the video signal,

wherein the video recognition device is configured to perform the video recognition processing on the partial video received through the communication network, and transmit the result of the video recognition processing to the video reception device through the communication network,

wherein the additional information distribution device is configured to transmit the additional information corresponding to the result of the video recognition processing received through the communication network, to the video reception device through the communication network, and

wherein the additional information display control unit is configured to divide the video signal and the template video into a plurality of regions, compare the template video and the video signal for each of the regions, calculate a similarity for each of the regions, compare the similarity with a threshold value set in advance, determine whether or not a number of regions whose similarities do not exceed the threshold value is equal to or greater than a predetermined number, and detect whether or not the UI image is included in the video signal.