Transmission apparatus, information processing method, program, reception apparatus, and application-coordinated system

• US 9,489,421 B2
• Filed: 07/09/2013
• Issued: 11/08/2016
• Est. Priority Date: 07/12/2012
• Status: Active Grant

• Current Assignee: Saturn Licensing LLC (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yamagishi, Yasuaki
• Primary Examiner(s): Stevens, Robert
• Application Number:
  US13/937,684
• Publication Number:
  US 20140019474A1
• Time in Patent Office: 1,218 Days
• Field of Search: 707/769
• US Class Current: 1/1
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

Disclosed herein is a transmission apparatus including: at least one content recognition section; and a timeline data generation section. The content recognition section has a database block configured to store reference data including at least signature data and a content identifier, and timeline data including at least an application identifier and timeline information. The content recognition section further has a response generation block configured to recognize content from which signature data included in a query, generate a response including the timeline data including a content identifier and the application identifier, and return the generated response to the reception apparatus. The timeline data generation section is configured to generate the timeline data and collectively supply the generated timeline data to the at least one content recognition section, the generated timeline data being common to the at least one content recognition section.

Claims

1. A transmission apparatus comprising:

content recognition circuitry configured to;

generate and store reference data including at least signature data, a content identifier and timeline data, the signature data including features of content that is reproduced on a reception apparatus and the signature data being generated from the content, the content identifier identifying the content from which the signature data is generated, the timeline data including at least an application identifier and reproduction time information, the application identifier identifying an application to be executed in coordination with the content, and the reproduction time information including an execution timing of the application and a progression time for reproducing the content at a time of generating the signature data, the progression time represented by an elapsed time amount from a beginning of the content;

in response to a query transmitted from the reception apparatus, recognize content from which signature data included in the query is extracted, based on the reference data;

generate a response including a content identifier of the recognized content and the timeline data, the timeline data including the application identifier of an application to be executed in coordination with the progression time of the recognized content; and

return the generated response to the reception apparatus, and timeline data generation circuitry configured to;

generate the timeline data; and

collectively supply the generated timeline data to the content recognition circuitry, the generated timeline data being common to the content recognition circuitry.

2. The transmission apparatus according to claim 1, wherein

the content recognition circuitry is further configured to control the timeline data generation circuitry by a user input via a user interface.

3. The transmission apparatus according to claim 2, wherein

the content recognition circuitry is further configured to extract the signature data from the content to be viewed on the reception apparatus by an extraction method corresponding to the content recognition circuitry.

4. The transmission apparatus according to claim 3, wherein the content recognition circuitry is further configured to generate the reference data by use of the signature data extracted by the content recognition circuitry.

5. The transmission apparatus according to claim 3, wherein the content recognition circuitry generates a finger print as the signature data.

6. An information processing method used in a transmission apparatus, the transmission apparatus including content recognition circuitry and timeline data generation circuitry, the information processing method comprising:

storing, by the content recognition circuitry, reference data including at least signature data, a content identifier and timeline data, the signature data including features of content that is reproduced on a reception apparatus and being generated from the content, the content identifier identifying the content from which the signature data is generated, the timeline data including at least an application identifier and reproduction time information, the application identifier identifying an application to be executed in coordination with the content, and the reproduction time information including an execution timing of the application and a progression time for reproducing the content at a time of generating the signature data, the progression time represented by an elapsed time amount from a beginning of the content,

in response to a query transmitted from the reception apparatus, recognizing, by the content recognition circuitry, content from which signature data included in the query is extracted, based on the reference data,

generating, by the content recognition circuitry, a response including a content identifier of the recognized content and the timeline data, the timeline data including the application identifier of an application to be executed in coordination with the progression time of the recognized content,

returning, by the content recognition circuitry, the generated response to the reception apparatus,

generating, by the timeline data generation circuitry, the timeline data to be collectively supplied to the content recognition circuitry, the generated timeline data being common to the content recognition circuitry, and

collectively supplying, by the timeline data generation circuitry, the common timeline data to the content recognition circuitry.

7. A non-transitory computer readable medium comprising computer program instructions that, when executed by a transmission apparatus comprising content recognition circuitry and timeline data generation circuitry cause the content recognition circuitry to:

generate and store reference data including at least signature data, a content identifier and timeline data, the signature data including features of content that is reproduced on a reception apparatus and being generated from the content, the content identifier identifying the content from which the signature data is generated, the timeline data including at least an application identifier and reproduction time information, the application identifier identifying an application to be executed in coordination with the content, and the reproduction time information including an execution timing of the application and a progression time for reproducing the content at a time of generating the signature data, the progression time represented by an elapsed time amount from a beginning of the content,

in response to a query transmitted from the reception apparatus, recognize content from which signature data included in the query is extracted, based on the reference data,

generate a response including a content identifier of the recognized content and the timeline data, the timeline data including the application identifier indicative of an application to be executed in coordination with the progression time of the recognized content,

return the generated response to the reception apparatus, wherein

the timeline data generation circuity is caused to;

generate the timeline data; and

collectively supply the generated timeline data to the content recognition circuity, the generated timeline data being common to the content recognition circuity.

8. A reception apparatus comprising:

circuitry configured to;

extract signature data including a feature of reproduced content from the reproduced content;

generate a query at least including the extracted signature data;

transmit the generated query to content recognition circuitry of a transmission apparatus;

receive a response returned from the content recognition circuitry in response to the query, the response including a content identifier of the reproduced content and timeline data, the timeline data including an application identifier of an application to be executed in coordination with the recognized content and reproduction time information, the reproduction time information including a progression time of the reproduced content represented by an elapsed time amount from a beginning of the content at a time of extracting the signature data, and the timeline data being supplied collectively and commonly to the content recognition circuitry;

capture an application corresponding to the reproduced content on the basis of the timeline data included in the received response; and

execute the captured application in coordination with the progression time of the reproduced content.

9. The reception apparatus according to claim 8, wherein the circuitry captures the application corresponding to the reproduced content on the basis of the application identifier included in the timeline data.

10. The reception apparatus according to claim 8, wherein the circuitry captures the application identifier of the application corresponding to the reproduced content on the basis of an event identifier included in the timeline data and captures the application corresponding to the reproduced content on the basis of the captured application identifier.

11. An application-coordinated system comprising:

a transmission apparatus configured to transmit content, and

a reception apparatus configured to receive the content, wherein

the transmission apparatus comprises content recognition circuitry and timeline data generation circuitry,

the content recognition circuitry configured to;

generate and store reference data including at least signature data, a content identifier and timeline data, the signature data including features of content that is reproduced on a reception apparatus and being generated from the content, the content identifier identifying the content from which the signature data is generated, the timeline data including at least an application identifier and reproduction time information, the application identifier identifying an application to be executed in coordination with the content, and the reproduction time information including an execution timing of the application and a progression time for reproducing the content at a time of generating the signature data, the progression time represented by an elapsed time amount from a beginning of the content;

in response to a query transmitted from the reception apparatus, recognize content from which signature data included in the query is extracted, based on the reference data;

generate a response including a content identifier of the recognized content and the timeline data, the timeline data including the application identifier of an application to be executed in coordination with the progression time of the recognized content; and

return the generated response to the reception apparatus, and

the timeline data generation circuitry configured to;

generate the timeline data; and

collectively supply the generated timeline data to the content recognition circuitry, the generated timeline data being common to the content recognition circuitry, and

the reception apparatus comprises circuitry configured to;

extract signature data including a feature of the reproduced content from the reproduced content;

generate a query at least including the extracted signature data;

transmit the generated query content recognition circuitry of a transmission apparatus;

receive a response returned from the content recognition circuitry in response to the query;

capture an application corresponding to the reproduced content on the basis of the timeline data included in the received response; and

execute the captured application in coordination with the progression time of the reproduced content.