Receiving device, receiving method, program, and information processing system

• US 8,938,756 B2
• Filed: 07/26/2012
• Issued: 01/20/2015
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Saturn Licensing LLC (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kitazato, Naohisa
• Primary Examiner(s): Chin, Ricky
• Assistant Examiner(s): Doshi, Akshay
• Application Number:
  US13/559,188
• Publication Number:
  US 20130198768A1
• Time in Patent Office: 908 Days
• Field of Search: 725/61, 725/93, 725/23, 725/60
• US Class Current: 725/40
• CPC Class Codes: G06F 13/00 Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units interface circuits for specific input/output devices G06F3/00 ; multiprogram control therefor G06F9/46; multiprocessor systems G06F15/16
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: H04H 2201/37 via a different channel
• CPC Class Codes: H04H 60/372 Programme
• CPC Class Codes: H04H 60/56 Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/442 Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8166 involving executable data, e.g. software arrangements for executing specific programs G06F9/44; broadcasting computer programmes in broadcast systems H04H20/91; involving the movement of software or configuration parameters H04L67/34
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/173 : with two-way working, e.g. subscriber sending a programme selection signal

Abstract

A receiving device includes: a receiver configured to receive AV content; a feature extractor configured to extract a feature from data of the received AV content; an identification result acquirer configured to acquire an identification result of the AV content identified from the extracted feature by using an Automatic Content Recognition technique; a command acquirer configured to acquire a command for controlling operation of an application program run in conjunction with the AV content in accordance with the acquired identification result; and a controller configured to control operation of the application program in accordance with the acquired command.

Claims

1. A receiving device comprising:

circuitry configured to;

receive audio video content,

extract a feature from data of the received audio video content,

provide the extracted feature to an Automatic Content Recognition (ACR) server,

receive, from the ACR server, a response which is based on an identification result of the audio video content identified from the extracted feature by using an ACR technique,

request and acquire a command from a command server corresponding to a location identified in the response from the ACR server,

request and acquire an application from an application server corresponding to a remote location of the application received from the command server, and

control operation of the application program, which is programmed to run in conjunction with the audio video content, in accordance with the command that is retrieved via a communication network from the location identified in the response from the ACR server, wherein

the ACR server, the command server, and the application server are distinct servers.

2. The receiving device according to claim 1, wherein:

the command indicates any of acquisition or registration, acquisition or activation, event firing, interruption, or stop of the application program; and

the circuitry controls acquisition or registration, or acquisition or activation of the application program, or event firing, suspension, or stop of the application program that is running, in accordance with each command.

3. The receiving device according to claim 1, wherein

the circuitry extracts the feature from either one or both of a video signal and an audio signal of the audio video content.

4. The receiving device according to claim 1, wherein the remote location includes a domain part, which references an Internet domain name and a directory path.

5. The receiving device according to claim 1, wherein the circuitry is further configured to

activate the application program when the acquired command is an execute command,

suspend execution of the application program when the acquired command is a suspend command, and

terminate execution of the application program when the acquired command is a terminate command.

6. The receiving device according to claim 1, wherein:

the ACR server, the command server, and the application server are physically distinct servers.

7. The receiving device according to claim 2, wherein:

time information indicating time at which the command is executed is included in the command; and

the circuitry executes the command in accordance with the time information.

8. The receiving device according to claim 7, wherein

the time information is information for executing the command at specific time set in advance irrespective of progression of the audio video content or information for executing the command when a specific time set in advance elapses in conjunction with progression of the audio video content.

9. The receiving device according to claim 7, wherein

the circuitry acquires the application program and then activates the acquired application program when it is time to execute the command, if the command indicates acquisition or activation and the application program is not acquired.

10. A method of a receiving device for controlling an application program, the method comprising:

receiving audio video content;

extracting a feature from data of the received audio video content;

providing the extracted feature to an Automatic Content Recognition (ACR) server,

receiving, from the ACR server, a response which is based on an identification result of the audio video content identified from the extracted feature by using an ACR technique,

requesting and acquiring, by circuitry of the receiving device, a command from a command server corresponding to a location identified in the response from the ACR server,

requesting and acquiring, by circuitry of the receiving device, an application from an application server corresponding to a remote location of the application received from the command server, and

controlling, by the circuitry of the receiving device, operation of an application program, which is programmed to run in conjunction with the audio video content, in accordance with the command that is retrieved via a communication network from the location identified in the response from the ACR server, wherein

the ACR server, the command server, and the application server are distinct servers.

11. The method according to claim 10, wherein:

the ACR server, the command server, and the application server are physically distinct servers.

12. A non-transitory computer-readable storage medium storing a program for causing a computer to:

receive audio video content;

extract a feature from data of the received audio video content;

provide the extracted feature to an Automatic Content Recognition (ACR) server,

receive, from the ACR server, a response which is based on an identification result of the audio video content identified from the extracted feature by using an ACR technique,

request and acquire a command from a command server corresponding to a location identified in the response from the ACR server,

request and acquire an application from an application server corresponding to a remote location of the application received from the command server, and

control operation of the application program, which is programmed to run in conjunction with the audio video content, in accordance with the command that is retrieved via a communication network from the location identified in the response from the ACR server, wherein

the ACR server, the command server, and the application server are distinct servers.

13. The non-transitory computer-readable storage medium according to claim 12, wherein:

the ACR server, the command server, and the application server are physically distinct servers.

14. An information processing system, comprising:

a receiving device, a first information processing subsystem, a second information processing subsystem, and a third information processing subsystem, wherein

the receiving device includes circuitry configured to;

receive audio video content,

extract a feature from data of the received audio video content,

provide the extracted feature to the first information processing subsystem,

receive, from the first information processing subsystem, a response which is based on an identification result of the audio video content identified from the extracted feature by using an ACR technique,

request and acquire a command from the second information processing subsystem corresponding to a location identified in the response from the first information processing subsystem,

request and acquire an application from a third information processing subsystem corresponding to a remote location of the application received from the second information processing subsystem, and

control operation of the application program, which is programmed to run in conjunction with the audio video content, in accordance with the command acquired from the second information processing subsystem via a communication network from the location identified in the response from the first information processing subsystem;

the first information processing subsystem is an Automatic Content Recognition (ACR) server and includes circuitry configured to;

identify the audio video content from the feature by using the ACR technique in response to a query from the receiving device;

the second information processing subsystem is a command server and includes circuitry configured to;

provide the command to the receiving device;

the third information processing subsystem is an application server and includes circuitry configured to

provide the application program in response to a query from the receiving device; and

the ACR server, the command server, and the application server are distinct servers.

15. The information processing system according to claim 14, wherein:

the ACR server, the command server, and the application server are physically distinct servers.