Apparatus and method for scene change detection-based trigger for audio fingerprinting analysis

• US 9,460,204 B2
• Filed: 10/19/2012
• Issued: 10/04/2016
• Est. Priority Date: 10/19/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Larsen, Tonni, Dawson, Thomas
• Primary Examiner(s): MCCORD, PAUL C
• Application Number:
  US13/656,152
• Publication Number:
  US 20140114455A1
• Time in Patent Office: 1,446 Days
• Field of Search: 700/94
• US Class Current: 1/1
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: H04H 60/375 Commercial
• CPC Class Codes: H04H 60/377 Scene
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00

Abstract

Certain aspects of an apparatus and method for scene change detection-based trigger for audio fingerprinting analysis may include a content-rendering device communicably coupled to a content-server. The content-rendering device may sample an audio component of the content at a sampling rate. The content-rendering device may generate and communicate to the content-server, an audio fingerprint based on the sampled audio component. The content-rendering device may further modify the sampling rate based on a detected scene change in the content. The scene change may be detected based on the communicated audio fingerprint. In another embodiment, the content-server may receive a plurality of audio fingerprints and detect a change in a type of content associated with the plurality of audio fingerprints. The content-server may further communicate a trigger signal to the content-rendering device that indicates the detected change in the type of content associated with the plurality of audio fingerprints.

Claims

1. A method for tracking content rendered on a content-rendering device that is communicably coupled to a content-server, said method comprising:

sampling by said content-rendering device, a first audio component of said content at a sampling rate;

generating and communicating to said content-server, a first audio fingerprint based on said sampled first audio component;

suspending said sampling for a predetermined period of time based on detection of a scene change in said content;

modifying said sampling rate after said predetermined period of time based on said detected scene change in said content, wherein said scene change is detected based on said communicated first audio fingerprint;

generating and communicating to said content-server, a second audio fingerprint based on a second audio component of said content sampled at said modified sampling rate;

receiving promotional content based on said second audio fingerprint generated at said modified sampling rate; and

displaying said promotional content as an overlay on said content when said content is a commercial content comprising at least an advertisement, wherein said promotional content is determined based on said commercial content.

2. The method of claim 1, wherein

said scene change indicates a change in a type of content.

3. The method of claim 2, wherein

said type of content comprises said commercial content and a non-commercial content.

4. The method of claim 3, comprising modifying said sampling rate when said type of content changes from said non-commercial content to said commercial content.

5. The method of claim 3, wherein said promotional content is associated with said commercial content.

6. The method of claim 3, comprising modifying said sampling rate when said type of content changes from said commercial content to said non-commercial content.

7. A method for tracking content rendered on a content-rendering device that is communicably coupled to a content-server, said method comprising:

receiving by said content-server, a first audio fingerprint sampled at a first sampling rate, wherein said first audio fingerprint is associated with said content being rendered at said content-rendering device at a first sampling instance;

detecting a change in a type of content based on a comparison of said first audio fingerprint with a pre-stored cluster of audio fingerprints for commercial content and for non-commercial content;

communicating a trigger signal to said content-rendering device, wherein said trigger signal indicates said detected change in said type of content associated with said first audio fingerprint, wherein said trigger signal instructs said content-rendering device to suspend sampling of said content being rendered at said content-rendering device for a predetermined period of time and to modify said first sampling rate of said content to a second sampling rate at said content-rendering device after said predetermined period of time;

receiving by said content-server, a second audio fingerprint sampled at said second sampling rate;

detecting whether said second audio fingerprint matches with said one or more pre-stored clusters for said commercial content;

identifying said commercial content based on said second audio fingerprint; and

communicating promotional content specific to identified commercial content to said content-rendering device, wherein said promotional content is displayed as an overlay to said identified commercial content on said content-rendering device.

8. The method of claim 7, wherein

said type of content comprises said commercial content and said non-commercial content.

9. An apparatus for tracking content rendered on a content-rendering device, said apparatus comprising:

one or more processors and/or circuits in said content-rendering device communicably coupled to a content-server, said one or more processors and/or circuits being operable to;

sample a first audio component of said content at a sampling rate;

generate and communicate to said content-server, a first audio fingerprint based on said sampled first audio component;

suspend said sampling for a predetermined period of time based on detection of a scene change in said content;

modify said sampling rate after said predetermined period of time based on said detected scene change in said content, wherein said scene change is detected based on said communicated first audio fingerprint;

generate and communicate to said content-server, a second audio fingerprint based on a second audio component of said content sampled at said modified sampling rate;

receive promotional content based on said second audio fingerprint generated at said modified sampling rate; and

display said promotional content as an overlay on said content when said content is a commercial content comprising at least an advertisement, wherein said promotional content is determined based on said commercial content.

10. The apparatus of claim 9, wherein

said one or more processors and/or circuits are operable to modify said sampling rate when a type of content changes from a non-commercial content to said commercial content.

11. The apparatus of claim 9, wherein

said one or more processors and/or circuits are operable to modify said sampling rate when a type of content changes from said commercial content to a non-commercial content.

12. The apparatus of claim 9, wherein

said one or more processors and/or circuits are operable to receive said promotional content is associated with said commercial content.

13. An apparatus for tracking content rendered on a content-rendering device, said apparatus comprising:

one or more processors and/or circuits in a content-server communicably coupled to said content-rendering device, said one or more processors and/or circuits being operable to;

receive a first audio fingerprint sampled at first sampling rate, wherein said first audio fingerprint is associated with said content being rendered at said content-rendering device at a first sampling instance;

detect a change in a type of content based on a comparison of said first audio fingerprint with a pre-stored cluster of audio fingerprints for commercial content and for non-commercial content;

communicate a trigger signal to said content-rendering device, wherein said trigger signal indicates said detected change in said type of content associated with said first audio fingerprint, wherein said trigger signal instructs said content-rendering device to suspend sampling of said content being rendered at said content-rendering device for a predetermined period of time and to modify said first sampling rate of said content to a second sampling rate at said content-rendering device after said predetermined period of time;

receive by said content-server, a second audio fingerprint sampled at said second sampling rate;

detect whether said second audio fingerprint matches with said one or more pre-stored clusters for said commercial content;

identify said commercial content based on said second audio fingerprint; and

communicate promotional content specific to identified commercial content to said content-rendering device, wherein said promotional content is displayed as an overlay to said identified commercial content on said content-rendering device.

14. The apparatus of claim 13, wherein

said content-server stores one or more pre-stored clusters, wherein said one or more pre-stored clusters comprise one or more audio fingerprints.