Syndication including melody recognition and opt out

• US 8,584,198 B2
• Filed: 11/12/2010
• Issued: 11/12/2013
• Est. Priority Date: 11/12/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: King, David G., Harrison, Kyle
• Primary Examiner(s): Nalven, Andrew L
• Assistant Examiner(s): MALINOWSKI, WALTER J
• Application Number:
  US12/945,240
• Publication Number:
  US 20120124638A1
• Time in Patent Office: 1,096 Days
• Field of Search: 705/51, 726/1, 726/21
• US Class Current: 726/1
• CPC Class Codes: A63H 5/00 Musical or noise- producing devices for additional toy effects other than acoustical musical tops A63H1/28; sound-producing dolls A63H3/28; musical toy vehicles A63H17/268; acoustical vehicle-signalling devices A63H17/32; whistling toy locomotive arrangements A63H19/14; music, sound or noise production in general G10
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06Q 10/101 Collaborative creation, e.g. joint development of products or services
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 50/00 Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism healthcare informatics G16H
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04L 63/20 for managing network security; network security policies in general filtering policies H04L63/0227
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2541 Rights Management protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31

Abstract

A syndication system facilitates rights management services between media content owners and media hosting services that elect to participate in the syndication system and mutually elect to participate with each other. The syndication system utilizes a content recognition system to identify hosted media content and ownership rights associated with the hosted content. By applying melody recognition, the content recognition system can identify compositions embodied in hosted media content even when these compositions do not precisely match any known sound recording. Thus, the content recognition system is beneficially able to detect, for example, recorded cover performances and recorded live performances embodied in hosted media content. Once identified, ownership information is determined and the syndication system can facilitate rights management policies associated with the content such as monetizing or blocking the protected content.

Claims

1. A computer-implemented method for facilitating a rights management service between a media content owner and a media hosting service, the method comprising:

receiving, by a computing device, an audio clip from a media hosting service, the audio clip digitally representing a sound recording;

processing, by the computing device, the audio clip to extract dominant musical tones in the audio clip at a plurality of times within the audio clip, the extracted tones corresponding to notes of a musical scale;

determining, by the computing device, pitch intervals between consecutive ones of the dominant musical tones extracted from the audio clip;

generating, by the computing device, an input melody fingerprint from a sequence of the pitch intervals for the audio clip, the input melody fingerprint representing a melody of an input composition that is embodied in the audio clip, the input melody fingerprint being invariant to parameters used to perform or record a performance of the input composition;

querying, by the computing device, a reference database for a reference melody fingerprint that matches the input melody fingerprint, each reference melody fingerprint in the reference database representing a melody of a reference composition that is embodied in a reference sound recording; and

responsive to a matching reference melody fingerprint for the input melody fingerprint being found, determining, by the computing device, a rights management policy associated with the reference composition that matches the input composition, and providing instructions to the media hosting service for carrying out the rights management policy associated with the reference composition.

2. The method of claim 1, further comprising:

determining a mutual agreement between the media hosting service and the media content owner to participate with each other in the rights management service.

3. The method of claim 2, wherein determining the mutual agreement comprises:

receiving an agreement over a first online interface from the media content owner to participate in the rights management service;

presenting to the media hosting service via a second online interface, an option to participate with the media content owner in the rights management service;

responsive to receiving from the media hosting service via the second online interface, an affirmative response to participate with the media content owner, presenting to the media content owner via the first online interface, an option to participate with the media hosting service; and

responsive to receiving from the media content owner via the first online interface, an affirmative response to participate with the media hosting service, facilitating the rights management service between the media hosting service and the media content owner.

4. The method of claim 1, wherein providing the instructions to the media hosting service for carrying out the rights management policy comprises:

transmitting to the media hosting service a request to block hosted media content including the audio clip from viewing by users of the media hosting service.

5. The method of claim 1, wherein providing the instructions to the media hosting service for carrying out the rights management policy comprises:

transmitting to the media hosting service a request to track statistical usage of hosted media content that includes the audio clip.

6. The method of claim 1, wherein providing the instructions to the media hosting service for carrying out the rights management policy comprises:

transmitting to the media hosting service, a request to monetize usage of the audio clip in accordance with a revenue sharing agreement between the media hosting service and the content owner of the matching reference composition.

7. The method of claim 1, wherein the reference sound recording corresponding to the matching reference melody fingerprint represents a first recorded performance of the input composition, and wherein the audio clip comprises a second recorded performance of the reference composition that matches the input composition, the second record performance different than the first recorded performance.

8. The method of claim 7, wherein the first recorded performance of the input composition comprises a performance by a first performer, and wherein the second recorded performance of the reference composition that matches the input composition comprises a performance by a second performer different than the first performer.

9. The method of claim 7, wherein the first recorded performance comprises a recorded studio performance of the input composition, and wherein the second recorded performance of the reference composition that matches the input composition comprises a recorded live performance of the composition.

10. The method of claim 1, further comprising:

generating an audio fingerprint for the audio clip, the audio fingerprint representing a sound recording embodied in the audio clip;

querying the reference database for a reference audio fingerprint matching the input audio fingerprint, the reference audio fingerprint representing a reference sound recording;

responsive to finding a matching reference audio fingerprint for the audio fingerprint in the reference database, determining a rights management policy associated with the reference sound recording; and

providing an indication of the rights management policy associated with the reference sound recording to the media hosting service.

11. The method of claim 1, wherein the audio clip comprises an audio track of a video clip.

12. A computer-implemented method for determining ownership rights to a sound recording, comprising:

receiving, by a computing device, a representation of an audio clip from a media hosting service;

generating, by the computing device, an input audio fingerprint for the audio clip, the audio fingerprint representing an input sound recording of an input composition that is embodied in the audio clip;

querying, by the computing device, a reference audio fingerprint database for a reference audio fingerprint that matches the input audio fingerprint, each reference audio fingerprint in the reference audio fingerprint database representing a reference sound recording; and

responsive to a matching reference audio fingerprint for the input audio fingerprint in the reference audio fingerprint database being found, determining, by the computing device, a rights management policy associated with the reference sound recording for the matching reference audio fingerprint, and providing instructions to the media hosting service for carrying out the rights management policy associated with the reference sound recording;

responsive to a matching reference audio fingerprint for the input audio fingerprint not being found;

generating, by the computing device, an input melody fingerprint for the audio clip, the input melody fingerprint different than the input audio fingerprint, the input melody fingerprint representing a melody of the input composition, the melody fingerprint being invariant to parameters used to perform or record a performance of the input composition;

querying, by the computing device, a reference melody fingerprint database for a reference melody fingerprint that matches the input melody fingerprint, each reference melody fingerprint in the reference melody fingerprint database representing a melody of a reference composition-corresponding to one of the reference sound recordings; and

responsive to a matching reference melody fingerprint for the input melody fingerprint being found, determining, by the computing device, a rights management policy associated with the reference composition for the matching reference melody fingerprint, and providing instructions to the media hosting service for carrying out the rights management policy associated with the reference composition.

13. The method of claim 12, wherein the matching reference melody fingerprint is derived from a first recorded performance of the reference composition, and wherein the matching audio fingerprint is derived from a second recorded performance of the reference composition that is different from the first recorded performance.

14. A system for facilitating a rights management service between a media content owner and a media hosting service, the system comprising:

a processor; and

a non-transitory computer-readable storage medium coupled to the processor, wherein the non-transitory computer-readable storage medium stores instructions that when executed cause the processor to;

receive an audio clip from a media hosting service, the audio clip digitally representing a sound recording;

process the audio clip to extract dominant musical tones in the audio clip at a plurality of times within the audio clip, the extracted tones corresponding to notes of a musical scale;

determine pitch intervals between consecutive ones of the dominant musical tones extracted from the audio clip;

generate an input melody fingerprint from a sequence of the pitch intervals for the audio clip, the input melody fingerprint representing a melody of an input composition that is embodied in the audio clip, the input melody fingerprint being invariant to parameters used to perform or record a performance of the input composition;

query a reference database for a reference melody fingerprint that matches the input melody fingerprint, each reference melody fingerprint in the reference database representing a melody of a reference composition that is embodied in a reference sound recording; and

responsive to a matching reference melody fingerprint for the input melody fingerprint being found, determine a rights management policy associated with the reference composition that matches the input composition, and provide instructions to the media hosting service for carrying out the rights management policy associated with the reference composition.

15. The system of claim 14, wherein the non-transitory computer-readable storage medium further stores instructions that when executed cause the processor to determine a mutual agreement between the media hosting service and the media content owner to participate with each other in the rights management service.

16. The system of claim 15, further comprising instructions stored in the non-transitory computer-readable storage medium that when executed cause the processor to:

receive an agreement over a first online interface from the media content owner to participate in the rights management service;

present to the media hosting service via a second online interface, an option to participate with the media content owner in the rights management service;

responsive to receiving from the media hosting service via the second online interface, an affirmative response to participate with the media content owner, present to the media content owner via the first online interface, an option to participate with the media hosting service; and

responsive to receiving from the media content owner via the first online interface, an affirmative response to participate with the media hosting service, facilitate the rights management service between the media hosting service and the media content owner.

17. The system of claim 14, further comprising instructions stored to the non-transitory computer-readable storage medium that when executed cause the processor to:

transmit to the media hosting service a request to block hosted media content including the audio clip from viewing by users of the media hosting service.

18. The system of claim 14, comprising instructions stored to the non-transitory computer-readable storage medium that when executed cause the processor to:

transmit to the media hosting service a request to track statistical usage of hosted media content that includes the audio clip.

19. The system of claim 14, further comprising instructions stored to the non-transitory computer-readable storage medium that when executed cause the processor to:

transmit to the media hosting service, a request to monetize usage of the audio clip in accordance with a revenue sharing agreement between the media hosting service and the content owner of the matching reference composition.

20. The system of claim 14, wherein the reference sound recording corresponding to the matching reference melody fingerprint represents a first recorded performance of the input composition, and wherein the audio clip comprises a second recorded performance of the reference composition that matches the input composition, the second record performance different than the first recorded performance.

21. The system of claim 20, wherein the first recorded performance of the input composition comprises a performance by a first performer, and wherein the second recorded performance of the reference composition that matches the input composition comprises a performance by a second performer different than the first performer.

22. The system of claim 20, wherein the first recorded performance comprises a recorded studio performance of the input composition, and wherein the second recorded performance of the reference composition that matches the input composition comprises a recorded live performance of the composition.

23. The system of claim 14, wherein the non-transitory computer-readable storage medium further stores instructions that when executed cause the processor to:

generate an audio fingerprint for the audio clip, the audio fingerprint representing a sound recording embodied in the audio clip;

query the reference database for a reference audio fingerprint matching the input audio fingerprint, the reference audio fingerprint representing a reference sound recording;

responsive to finding a matching reference audio fingerprint for the audio fingerprint in the reference database, determine a rights management policy associated with the reference sound recording; and

provide an indication of the rights management policy associated with the reference sound recording to the media hosting service.

24. The system of claim 14, wherein the audio clip comprises an audio track of a video clip.

25. A system for determining ownership rights to a sound recording, the system comprising:

a processor; and

a non-transitory computer-readable storage medium coupled to the processor, wherein the non-transitory computer-readable storage medium stores instructions that when executed cause the processor to;

receive a representation of an audio clip from a media hosting service;

generate an input audio fingerprint for the audio clip, the audio fingerprint representing an input sound recording of an input composition that is embodied in the audio clip;

query a reference audio fingerprint database for a reference audio fingerprint that matches the input audio fingerprint, each reference audio fingerprint in the reference audio fingerprint database representing a reference sound recording; and

responsive to a matching reference audio fingerprint for the input audio fingerprint in the reference audio fingerprint database being found, determine a rights management policy associated with the reference sound recording for the matching reference audio fingerprint, and provide instructions to the media hosting service for carrying out the rights management policy associated with the reference sound recording;

responsive to a matching reference audio fingerprint for the input audio fingerprint not being found;

generate an input melody fingerprint for the audio clip, the input melody fingerprint different than the input audio fingerprint, the input melody fingerprint representing a melody of the input composition, the melody fingerprint being invariant to parameters used to perform or record a performance of the input composition;

query a reference melody fingerprint database for a reference melody fingerprint that matches the input melody fingerprint, each reference melody fingerprint in the reference melody fingerprint database representing a melody of a reference composition corresponding to one of the reference sound recordings; and

responsive to a matching reference melody fingerprint for the input melody fingerprint being found, determine a rights management policy associated with the reference composition for the matching reference melody fingerprint, and provide instructions to the media hosting service for carrying out the rights management policy associated with the reference composition.

26. The system of claim 25, wherein the matching reference melody fingerprint is derived from a first recorded performance of the reference composition, and wherein the matching audio fingerprint is derived from a second recorded performance of the reference composition that is different from the first recorded performance.