Video reception device, video recognition method, and display system for providing additional information to be superimposed on displayed image

• US 9,906,843 B2
• Filed: 07/03/2014
• Issued: 02/27/2018
• Est. Priority Date: 09/04/2013
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Yabu, Hiroshi, Oku, Hirotaka
• Primary Examiner(s): NGUYEN BA, HOANG VU A
• Application Number:
  US14/888,445
• Publication Number:
  US 20160119688A1
• Time in Patent Office: 1,335 Days
• Field of Search: None
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/635 Overlay text, e.g. embedded captions in a TV program
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/237 Communication with additional data server
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/437 Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/4856 for language selection, e.g. for the menu or subtitles
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

Video recognition processing on video signals input from an outside is performed. Hence, video reception device which is configured to transmit and receive data through communication network includes input unit, video extraction unit, video recognition region setting unit, control unit and additional information display control unit. The video recognition region setting unit detects superimposing information superimposed on a partial video, and sets a video recognition region or video recognition candidate regions to the partial video based on a detection result. The additional information display control unit generates content recognition information in the video recognition region or in the video recognition candidate regions of the partial video. The control unit performs control of requesting video recognition device to perform video recognition processing on this content recognition information.

Claims

1. A video reception device configured to transmit and receive data through a communication network, the video reception device comprising:

an input unit configured to receive an input of a video signal;

a video extraction unit configured to extract a partial video for video recognition processing, from the video signal;

a video recognition region setting unit configured to detect superimposing information superimposed on the partial video, and set a video recognition region to a region of the partial video except for a display region of the superimposing information;

an additional information display control unit configured to generate content recognition information from the video recognition region set by the video recognition region setting unit; and

a control unit configured to perform control of transmitting the content recognition information to a video recognition device connected to the communication network so as to request the video recognition device to perform the video recognition processing, obtaining a result of the video recognition processing from the video recognition device, and obtaining additional information based on the result of the video recognition processing from an additional information distribution device connected to the communication network.

2. The video reception device according to claim 1, further comprising:

a displaying unit configured to display a video obtained by superimposing the additional information on the video signal.

3. The video reception device according to claim 1,

wherein the additional information display control unit is configured to perform control of superimposing the additional information on the video recognition region of the video signal.

4. The video reception device according to claim 1,

wherein the video recognition region setting unit is configured to perform at least one of text detection processing on the partial video and pattern matching processing on the partial video and a predetermined template image to detect a display region of the superimposing information, and set the video recognition region to a region except for the display region.

5. The video reception device according to claim 1,

wherein the video recognition region setting unit is configured to, when the superimposing information is not detected, divide the partial video into a plurality of regions and set video recognition candidate regions,

the additional information display control unit is configured to generate content recognition information of each of a plurality of the video recognition candidate regions, and

the control unit is configured to perform control of transmitting a plurality of pieces of the content recognition information to the video recognition device so as to request the video recognition device to perform the video recognition processing on each of the content recognition information.

6. The video reception device according to claim 5,

wherein the additional information display control unit is configured to perform control of superimposing the additional information on the video recognition candidate regions, for which the video recognition processing succeeds, of the video signal.

7. A video recognition method of a video reception device configured to transmit and receive data through a communication network, the video recognition method comprising:

extracting a partial video for video recognition processing, from a video signal input from an outside;

detecting superimposing information superimposed on the partial video, and setting a video recognition region to a region of the partial video except for a display region of the superimposing information;

generating content recognition information from the video recognition region of the partial video;

transmitting the content recognition information to a video recognition device connected to the communication network so as to request the video recognition device to perform the video recognition processing, and obtaining a result of the video recognition processing from the video recognition device; and

obtaining additional information based on the result of the video recognition processing, from an additional information distribution device connected to the communication network.

8. The video recognition method according to claim 7, further comprising:

displaying, on a displaying unit, a video obtained by superimposing the additional information on the video signal.

9. The video recognition method according to claim 7, further comprising:

superimposing the additional information on the video recognition region of the video signal.

10. The video recognition method according to claim 7, further comprising:

performing at least one of text detection processing on the partial video and pattern matching processing on the partial video and a predetermined template image to detect a display region of the superimposing information,

wherein the video recognition region is set to a region except for the display region.

11. The video recognition method according to claim 7,

wherein when the superimposing information is not detected, the partial video is divided into a plurality of regions and video recognition candidate regions are set,

content recognition information of each of a plurality of the video recognition candidate regions is generated, and

a plurality of pieces of the content recognition information are transmitted to the video recognition device to request the video recognition device to perform the video recognition processing on each of the content recognition information.

12. The video recognition method according to claim 11,

wherein the additional information is superimposed on the video recognition candidate regions, for which the video recognition processing succeeds, of the video signal.

13. An additional information display system which comprises a video reception device, a video recognition device, and an additional information distribution device, the devices being configured to transmit and receive data to each other through a communication network,

wherein the video reception device includes:

an input unit configured to receive an input of a video signal;

a video extraction unit configured to extract a partial video for video recognition processing, from the video signal;

a video recognition region setting unit configured to detect superimposing information superimposed on the partial video, and set a video recognition region to a region of the partial video except for a display region of the superimposing information;

an additional information display control unit configured to generate content recognition information from the video recognition region set by the video recognition region setting unit; and

a control unit configured to perform control of transmitting the content recognition information to the video recognition device through the communication network so as to request the video recognition device to perform the video recognition processing, obtaining a result of the video recognition processing from the video recognition device through the communication network, and obtaining additional information based on the result of the video recognition processing from the additional information distribution device through the communication network,

wherein the video recognition device is configured to perform the video recognition processing on the content recognition information received through the communication network, and transmit the result of the video recognition processing to the video reception device through the communication network, and

wherein the additional information distribution device is configured to transmit the additional information corresponding to the result of the video recognition processing received through the communication network, to the video reception device through the communication network.