INFORMATION PROCESSING APPARATUS, METHOD, AND PROGRAM

• US 20160269762A1
• Filed: 10/10/2014
• Published: 09/15/2016
• Est. Priority Date: 10/21/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Inoue, Akira, Takahashi, Shusuke, Nishiguchi, Masayuki
• Granted Patent: US 10,484,728 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/23602 Multiplexing isochronously with the video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4342 Demultiplexing isochronously with video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 5/60 for the sound signals

Abstract

An information processing apparatus for reproducing second content in synchronization with reproduction of first content by a second information processing apparatus different from the information processing apparatus, the first content comprising audio content. The information processing apparatus comprising circuitry configured to: extract a first feature from the audio content; obtain a second feature of the audio content, the second feature being together with the second content; compare the first feature with the second feature; and generate, based on results of the comparing, synchronization information used for reproducing the second content in synchronization with the first content.

Claims

1. An information processing apparatus for reproducing second content in synchronization with reproduction of first content by a second information processing apparatus different from the information processing apparatus, the first content comprising audio content, the information processing apparatus comprising:

circuitry configured to;

extract a first feature from the audio content;

obtain a second feature of the audio content, the second feature being together with the second content;

compare the first feature with the second feature; and

generate, based on results of the comparing, synchronization information used for reproducing the second content in synchronization with the first content.

2. The information processing apparatus of claim 1, wherein the circuitry is configured to:

acquire an audio signal from sound generated via reproduction of the audio content by the second information processing apparatus; and

extract the first feature from the audio signal.

3. The information processing apparatus of claim 1, wherein the second content and the second feature are transmitted to the information processing apparatus at a time determined based on a difference between an arrival time of the first content and an arrival time of the second content and the second feature.

4. The information processing apparatus of claim 1, wherein the circuitry is configured to:

request transmission of the second content and the second feature; and

receive the second content and the second feature which are transmitted in response to the request.

5. The information processing apparatus of claim 4, wherein the circuitry is configured to:

request transmission of the first content; and

receive the first content which is transmitted in response to the request for transmission of the first content.

6. The information processing apparatus of claim 1, wherein the circuitry is configured to:

extract a first plurality of features from the audio content, the first plurality of features including the first feature;

obtain a second plurality of features together with the second content, the second plurality of features including the second feature;

compare the first plurality of features with the second plurality of features; and

generate, based on results of comparing the first plurality of features with the second plurality of features, the synchronization information used for reproducing the second content in synchronization with the first content.

7. The information processing apparatus of claim 1, wherein the circuitry is configured to control reproduction of the second content.

8. The information processing apparatus of claim 7, wherein the circuitry is configured to correct a reproduction position of the second content based on the synchronization information.

9. The information processing apparatus of claim 1, wherein the circuitry is configured to:

acquire presentation time information associated with the first content; and

obtain a range of time based on results of comparing the presentation time information associated with the first content and presentation time information associated with the second content,

wherein the circuitry is configured to generate the synchronization information at least in part by comparing the second feature with one or more features extracted from one or more portions of the first content appearing in the first content in the range of time.

10. The information processing apparatus of claim 1, wherein the circuitry is configured to compare the first feature and the second feature after performing frame rate conversion on at least one of the first feature and the second feature such that a frame rate of the first feature coincides with a frame rate of the second feature.

11. An information processing method for reproducing second content in synchronization with reproduction of first content, the first content comprising audio content, the information processing method comprising:

extracting a first feature from the audio content;

obtaining a second feature of the audio content, the second feature being together with the second content;

comparing the first feature with the second feature; and

generating, based on results of the comparing, synchronization information used for reproducing the second content in synchronization with the first content.

12. At least one non-transitory computer readable storage medium storing processor-executable instructions that, when executed by at least one computer, causes the at least one computer to perform an information processing method for reproducing second content in synchronization with reproduction of first content, the first content comprising audio content, the information processing method comprising:

extracting a first feature from the audio content;

obtaining a second feature of the audio content, the second feature being together with the second content;

comparing the first feature with the second feature; and

generating, based on results of the comparing, synchronization information used for reproducing the second content in synchronization with the first content.

13. An information processing apparatus, comprising:

circuitry configured to;

extract a feature from sound generated by reproduction of first content;

associate, in synchronization with the first content, the feature with second content that has a time-synchronized relationship with the first content; and

output second content and the feature.

14. The information processing apparatus of claim 13, wherein the circuitry is configured to output the first content.

15. The information processing apparatus of claim 14, wherein the circuitry is configured to output the second content and the feature at a time determined based on a difference between arrival time of the first content and the second content.

16. The information processing apparatus of claim 14, wherein the circuitry is configured to output the second content and the feature in response to a request for their transmission.

17. The information processing apparatus of claim 16, wherein the circuitry is configured to output the first content in response to a request for its transmission.

18. The information processing apparatus of claim 13, wherein the circuitry is configured to:

extract a plurality of features from sound generated from reproducing a plurality of portions of the first content; and

associate and output the extracted features with the second content.

19. The information processing apparatus of claim 13, wherein the circuitry is configured to:

downsample the feature to obtain a downsampled feature; and

output the second content and the downsampled feature.

20. An information processing method, comprising:

extracting a feature from sound generated by reproduction of first content;

associating, in synchronization with the first content, the feature with second content that has a time-synchronized relationship with the first content; and

outputting the second content and the feature.

21. At least one non-transitory computer-readable storage medium that, when executed by at least one computer, causes the at least one computer to perform:

extracting a feature from sound generated by reproduction of first content;

associating, in synchronization with the first content, the feature with second content that has a time-synchronized relationship with the first content; and

outputting the second content and the feature.