Video reception device, added-information display method, and added-information display system

• US 9,762,951 B2
• Filed: 07/03/2014
• Issued: 09/12/2017
• Est. Priority Date: 07/30/2013
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.), Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Yabu, Hiroshi
• Primary Examiner(s): Asanbayev, Oleg
• Application Number:
  US14/787,759
• Publication Number:
  US 20160088340A1
• Time in Patent Office: 1,167 Days
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/237 Communication with additional data server
• CPC Class Codes: H04N 21/26233 involving content or additional data duration or size, e.g. length of a movie, size of an executable file
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/488 Data services, e.g. news ticker systems specially adapted for using meteorological information in broadcast systems H04H60/71
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

Additional information related to video signals input from an outside is obtained and superimposed on the video signals. Hence, video reception device which is configured to transmit and receive data through communication network includes input unit, video extraction unit, control unit and additional information display control unit. The control unit performs control of requesting video recognition device to perform video recognition processing on a partial video extracted by the video extraction unit, and obtaining a result of the video recognition processing and display control information of additional information from the video recognition device. The additional information display control unit performs control of calculating a display ending time of the additional information based on a system time at which the video extraction unit extracts the partial video, and the display control information, and superimposing the additional information on the video signal based on the display ending time.

Claims

1. A video reception device configured to transmit and receive data through a communication network, the video reception device comprising:

an input unit configured to receive an input of a video signal;

a video extraction unit configured to extract a partial video for video recognition processing, from the video signal;

a control unit configured to perform control of transmitting the partial video to a video recognition device connected to the communication network so as to request the video recognition device to perform the video recognition processing, obtaining a result of the video recognition processing and display control information of additional information from the video recognition device, and obtaining additional information based on the result of the video recognition processing from an additional information distribution device connected to the communication network;

an additional information display control unit configured to perform control of calculating a display ending time or a display remaining time of the additional information based on a system time at which the video extraction unit extracts the partial video, and the display control information, and superimposing the additional information on the video signal based on the display ending time or the display remaining time;

a displaying unit configured to display a video obtained by superimposing the additional information on the video signal,

wherein the additional information display control unit is configured to perform control of hiding the additional information which is being displayed on the displaying unit, based on the display ending time or the display remaining time; and

a storage unit configured to store the display ending time or the display remaining time;

wherein the additional information display control unit is configured to perform control of causing the storage unit to store the calculated display ending time or display remaining time, comparing the calculated display ending time or display remaining time and the display ending time or display remaining time stored in the storage unit every time the video extraction unit extracts the partial video, updating the display ending time or the display remaining time by storing temporally earlier one of the display ending times or the display remaining times in the storage unit, and hiding the additional information which is being displayed on the displaying unit at the display ending time or the display remaining time stored in the storage unit.

2. The video reception device according to claim 1, wherein the display control information, which the control unit obtains from the video recognition device, includes information indicating a display period of the additional information, and information indicating an offset time.

3. The video reception device according to claim 1, wherein the control unit is configured to perform control of transmitting a plurality of pieces of time stamp information together with the partial video when transmitting the partial video to the video recognition device connected to the communication network.

4. The video reception device according to claim 1, wherein the control unit is configured to perform control of obtaining a plurality of pieces of the additional information including display time range information, from the additional information distribution device based on the result of the video recognition processing, and the additional information display control unit is configured to perform control of displaying the plurality of pieces of the additional information on the displaying unit by switching between the plurality of pieces of the additional information according to the display time range information.

5. A video reception device configured to transmit and receive data through a communication network, the video reception device comprising:

an input unit configured to receive an input of a video signal;

a video extraction unit configured to extract a partial video for video recognition processing, from the video signal;

a control unit configured to perform control of transmitting the partial video to a video recognition device connected to the communication network so as to request the video recognition device to perform the video recognition processing, transmitting a system time at which the video extraction unit extracts the partial video, obtaining a result of the video recognition processing and a display ending time of additional information or a display remaining time of the additional information from the video recognition device, and obtaining additional information based on the result of the video recognition processing from an additional information distribution device connected to the communication network;

an additional information display control unit configured to perform control of superimposing the additional information on the video signal based on the display ending time or the display remaining time obtained from the video recognition device;

a displaying unit configured to display a video obtained by superimposing the additional information on the video signal, wherein the additional information display control unit is configured to perform control of hiding the additional information which is being displayed on the displaying unit, based on the display ending time or the display remaining time; and

a storage unit configured to store the display ending time or the display remaining time;

wherein the additional information display control unit is configured to perform control of causing the storage unit to store the obtained display ending time or display remaining time, comparing the obtained display ending time or display remaining time and the display ending time or the display remaining time stored in the storage unit every time the video extraction unit extracts the partial video, updating the display ending time or the display remaining time by storing temporally earlier one of the display ending times or the display remaining times in the storage unit, and hiding the additional information which is being displayed on the displaying unit at the display ending time or the display remaining time stored in the storage unit.

6. An additional information display method of a video reception device configured to transmit and receive data through a communication network, the additional information display method comprising:

extracting a partial video for video recognition processing, from a video signal input from an outside;

transmitting the partial video to a video recognition device connected to the communication network so as to request the video recognition device to perform the video recognition processing, and obtaining a result of the video recognition processing and display control information of additional information, from the video recognition device;

obtaining additional information based on the result of the video recognition processing, from an additional information distribution device connected to the communication network;

calculating a display ending time or a display remaining time of the additional information based on a system time at which the partial video is extracted, and the display control information;

performing control of superimposing the additional information on the video signal based on the display ending time or the display remaining time;

displaying, on a displaying unit, a video obtained by superimposing the additional information on the video signal, wherein the additional information which is being displayed on the displaying unit is hidden based on the display ending time or the display remaining time; and

storing the display ending time or the display remaining time, wherein the calculated display ending time or display remaining time is stored, the calculated display ending time or display remaining time and the stored display ending time or display remaining time are compared every time the partial video is extracted, the display ending time or the display remaining time is updated by storing temporally earlier one of the display ending times or the display remaining times, and the additional information which is being displayed on the displaying unit is hidden at the stored display ending time or display remaining time of the additional information.

7. The additional information display method according to claim 6, wherein the display control information includes information indicating a display period of the additional information, and information indicating an offset time.

8. The additional information display method according to claim 6, wherein a plurality of pieces of time stamp information are transmitted together with the partial video when the partial video is transmitted to the video recognition device connected to the communication network.

9. The additional information display method according to claim 6, wherein a plurality of pieces of the additional information including display time range information are obtained from the additional information distribution device based on the result of the video recognition processing, and the plurality of pieces of the additional information are displayed on the displaying unit by switching between the plurality of pieces of the additional information according to the display time range information.

10. An additional information display method of a video reception device configured to transmit and receive data through a communication network, the additional information display method comprising:

extracting a partial video for video recognition processing, from a video signal input from an outside;

transmitting the partial video to a video recognition device connected to the communication network so as to request the video recognition device to perform the video recognition processing, transmitting a system time at which the partial video is extracted, and obtaining a result of the video recognition processing and a display ending time of additional information or a display remaining time of the additional information from the video recognition device;

obtaining additional information based on the result of the video recognition processing, from an additional information distribution device connected to the communication network;

performing control of superimposing the additional information on the video signal based on the display ending time or the display remaining time obtained from the video recognition device;

displaying, on a displaying unit, a video obtained by superimposing the additional information on the video signal, wherein the additional information which is being displayed on the displaying unit is hidden based on the display ending time or the display remaining time; and

storing the display ending time or the display remaining time, wherein the obtained display ending time or display remaining time is stored, the obtained display ending time or display remaining time and the stored display ending time or display remaining time are compared every time the partial video is extracted, the display ending time or the display remaining time is updated by storing temporally earlier one of the display ending times or the display remaining times, and the additional information which is being displayed on the displaying unit is hidden at the stored display ending time or display remaining time of the additional information.

11. An additional information display system which comprises a video reception device, a video recognition device, and an additional information distribution device, the devices being configured to transmit and receive data to each other through a communication network, wherein the video reception device includes:

an input unit configured to receive an input of a video signal;

a video extraction unit configured to extract a partial video for video recognition processing, from the video signal;

a control unit configured to perform control of transmitting the partial video to the video recognition device through the communication network so as to request the video recognition device to perform the video recognition processing, obtaining a result of the video recognition processing and display control information of additional information from the video recognition device through the communication network, and obtaining additional information based on the result of the video recognition processing from the additional information distribution device through the communication network;

an additional information display control unit configured to perform control of calculating a display ending time or a display remaining time of the additional information based on a system time at which the video extraction unit extracts the partial video, and the display control information, and superimposing the additional information on the video signal based on the display ending time or the display remaining time; and

a storage unit configured to store the display ending time or the display remaining time, wherein the video recognition device is configured to receive the partial video transmitted from the video reception device through the communication network, perform the video recognition processing using the partial video, and output the result of the video recognition processing and the display control information to the video reception device through the communication network, wherein the additional information distribution device is configured to transmit additional information corresponding to the result of the video recognition processing received through the communication network, to the video reception device through the communication network,

a displaying unit configured to display a video obtained by superimposing the additional information on the video signal, wherein the additional information display control unit is configured to perform control of hiding the additional information which is being displayed on the displaying unit, based on the display ending time or the display remaining time; and

wherein the additional information display control unit is configured to perform control of causing the storage unit to store the calculated display ending time or display remaining time, comparing the calculated display ending time or display remaining time and the display ending time or display remaining time stored in the storage unit every time the video extraction unit extracts the partial video, updating the display ending time or the display remaining time by storing temporally earlier one of the display ending times or the display remaining times in the storage unit, and hiding the additional information which is being displayed on the displaying unit at the display ending time or the display remaining time stored in the storage unit.

12. An additional information display system which comprises a video reception device, a video recognition device, and an additional information distribution device, the devices being configured to transmit and receive data to each other through a communication network, wherein the video reception device includes:

an input unit configured to receive an input of a video signal;

a video extraction unit configured to extract a partial video for video recognition processing, from the video signal;

a control unit configured to perform control of transmitting the partial video to the video recognition device through the communication network so as to request the video recognition device to perform the video recognition processing, transmitting a system time at which the video extraction unit extracts the partial video to the video recognition device, obtaining a result of the video recognition processing and a display ending time of additional information or a display remaining time of the additional information from the video recognition device through the communication network, and obtaining additional information based on the result of the video recognition processing from the additional information distribution device through the communication network; and

an additional information display control unit configured to perform control of superimposing the additional information on the video signal based on the display ending time or the display remaining time obtained from the video recognition device; and

a storage unit configured to store the display ending time or the display remaining time, wherein the video recognition device is configured to receive the partial video and the system time transmitted from the video reception device through the communication network, perform the video recognition processing using the received partial video, output the result of the video recognition processing to the video reception device through the communication network, and transmit the display ending time or the display remaining time based on the system time, to the video reception device through the communication network,

wherein the additional information distribution device is configured to transmit the additional information corresponding to the result of the video recognition processing received through the communication network, to the video reception device through the communication network,

displaying, on a displaying unit, a video obtained by superimposing the additional information on the video signal, wherein the additional information which is being displayed on the displaying unit is hidden based on the display ending time or the display remaining time; and

wherein the additional information display control unit is configured to perform control of causing the storage unit to store the obtained display ending time or display remaining time, comparing the obtained display ending time or display remaining time and the display ending time or the display remaining time stored in the storage unit every time the video extraction unit extracts the partial video, updating the display ending time or the display remaining time by storing temporally earlier one of the display ending times or the display remaining times in the storage unit, and hiding the additional information which is being displayed on the displaying unit at the display ending time or the display remaining time stored in the storage unit.