Video reception device, video recognition method and additional information display system

• US 9,774,924 B2
• Filed: 07/16/2014
• Issued: 09/26/2017
• Est. Priority Date: 03/26/2014
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Yabu, Hiroshi
• Primary Examiner(s): Chowdhury, Sumaiya A
• Application Number:
  US14/888,447
• Publication Number:
  US 20160088364A1
• Time in Patent Office: 1,168 Days
• CPC Class Codes: G06F 13/00 Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units interface circuits for specific input/output devices G06F3/00 ; multiprogram control therefor G06F9/46; multiprocessor systems G06F15/16
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/48 Matching video sequences
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/237 Communication with additional data server
• CPC Class Codes: H04N 21/25841 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; arrangements for identifying locations of receiving stations in broadcast systems H04H60/51; location of the user terminal in data switching networks H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/437 Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/265 Mixing

Abstract

Video recognition processing regarding a video signal input from an outside is performed. Hence, video reception device configured to perform transmission/reception of data through communication network includes input unit, video extraction unit, storage unit, video recognition unit, and control unit. The video recognition unit performs at least one of: online matching processing for generating second content recognition information from a partial video extracted by the video extraction unit, transmitting the second content recognition information to video recognition device so as to request video recognition device to perform video recognition processing; and local matching processing for collating the second content recognition information with first content recognition information stored in the storage unit.

Claims

1. A video reception device configured to be capable of performing transmission/reception of data through a communication network, the video reception device comprising:

an input unit configured to receive a video signal;

a video extraction unit configured to extract a partial video for video recognition processing from the video signal;

a storage unit configured to store first content recognition information acquired from a video recognition device connected to the video reception device via the communication network;

a video recognition unit configured to generate second content recognition information from the partial video, and to perform at least one of;

online matching processing for transmitting the second content recognition information to the video recognition device so as to request the video recognition device to perform video recognition processing, and local matching processing for collating the second content recognition information with the first content recognition information stored in the storage unit; and

a control unit configured to perform control of acquiring additional information from an additional information distribution device connected to the communication network, the additional information being based on a result of the online matching processing or a result of the local matching processing,

wherein the local matching processing is performed prior to the online matching processing, and the online matching processing is performed when the local matching processing fails, and

wherein the control unit is configured to determine a validated period of the first content recognition information, and to update the first content recognition information based on a result of the determination.

2. The video reception device according to claim 1, further comprising:

a displaying unit configured to display a video in which the additional information is superimposed on the video signal.

3. The video reception device according to claim 1,

wherein the control unit is configured to perform control of updating the first content recognition information at one or more of the following timings:

(i) after a power supply to the video reception device is turned on,

(ii) after a viewing channel of the video reception device is switched, and

(iii) after the power supply to the video reception device is turned off, by using a backup power supply provided in the video reception device.

4. A video recognition method in a video reception device configured to be capable of performing transmission/reception of data through a communication network, the video recognition method comprising:

extracting a partial video for video recognition processing from a video signal input from an outside;

acquiring first content recognition information from a video recognition device via the communication network, and storing the first content recognition information in a storage unit;

generating second content recognition information from the partial video;

performing at least one of;

online matching processing for transmitting the second content recognition information to the video recognition device so as to request the video recognition device to perform video recognition processing, and local matching processing for collating the second content recognition information with the first content recognition information stored in the storage unit; and

acquiring additional information from an additional information distribution device connected to the communication network, the additional information being based on a result of the online matching processing or a result of the local matching processing,

wherein the local matching processing is performed prior to the online matching processing, and the online matching processing is performed when the local matching processing fails, and

wherein a validated period of the first content recognition information is determined, and the first content recognition information is updated based on a result of the determination.

5. The video recognition method according to claim 4, further comprising:

displaying, on a displaying unit, a video in which the additional information is superimposed on the video signal.

6. The video recognition method according to claim 4,

wherein the first content recognition information is updated at one or more of the following timings:

(i) after a power supply to the video reception device is turned on,

(ii) after a viewing channel of the video reception device is switched, and

(iii) after the power supply to the video reception device is turned off, by using a backup power supply provided in the video reception device.

7. An additional information display system including a video reception device, a video recognition device, and an additional information distribution device, the devices being configured to be capable of performing mutual transmission/reception of data through a communication network,

wherein the video reception device includes:

an input unit configured to receive a video signal;

a video extraction unit configured to extract a partial video for video recognition processing from the video signal;

a storage unit configured to store first content recognition information acquired from the video recognition device through the communication network;

a video recognition unit configured to generate second content recognition information from the partial video, and to perform at least one of;

online matching processing for transmitting the second content recognition information to the video recognition device through the communication network so as to request the video recognition device to perform video recognition processing, and local matching processing for collating the second content recognition information with the first content recognition information stored in the storage unit; and

a control unit configured to perform control of acquiring additional information from the additional information distribution device through the communication network, the additional information being based on a result of the online matching processing or a result of the local matching processing,

wherein the video recognition unit is configured;

to perform the local matching processing prior to the online matching processing, and to perform the online matching processing when the local matching processing fails,

wherein the control unit is configured;

to determine a validated period of the first content recognition information, and to update the first content recognition information based on a result of the determination,

wherein the video recognition device is configured;

to generate the first content recognition information from the acquired video signal and store the generated first content recognition information, and to transmit the first content recognition information to the video reception device, and configured to collate the second content recognition information, which is received through the communication network, with the stored first content recognition information and perform the online matching processing, and

wherein the additional information distribution device is configured;

to transmit additional information to the video reception device through the communication network, the additional information corresponding to a result of the online matching processing received through the communication network, or a result of the local matching processing.