Blocking of unlicensed audio content in video files on a video hosting website

• US 9,424,402 B2
• Filed: 09/19/2013
• Issued: 08/23/2016
• Est. Priority Date: 11/03/2006
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Chastagnol, Franck, Karunamurthy, Vijay, Liu, Matthew, Maxcy, Christopher
• Primary Examiner(s): Perveen, Rehana
• Assistant Examiner(s): Wong, Huen
• Application Number:
  US14/031,931
• Publication Number:
  US 20140020116A1
• Time in Patent Office: 1,069 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/64 Browsing; Visualisation therefor generation of a list or set of audio data G06F16/638
• CPC Class Codes: G06F 16/686 using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 21/1015 to users
• CPC Class Codes: G06F 21/105 Arrangements for software license management or administration, e.g. for managing licenses at corporate level
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4542 Blocking scenes or portions of the received content, e.g. censoring scenes
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: Y10S 707/914 Video
• CPC Class Codes: Y10S 707/916 Audio
• CPC Class Codes: Y10S 707/944 Business related

Abstract

A system, method and various software tools enable a video hosting website to automatically identified unlicensed audio content in video files uploaded by users, and initiate a process by which the user can replace the unlicensed content with licensed audio content. An audio replacement tool is provided that enables the user to permanently mute the original, unlicensed audio content of a video file, or select a licensed audio file from a collection of licensed audio, and insert the selected in place of the original audio. Where a video file includes unlicensed audio, the video hosting website provides access to video files to a client device, along with an indication to the client device to mute the audio during playback of the video.

Claims

1. A computer-implemented method of managing the playback of video files stored on a video hosting server, the video files containing audio content, the method comprising:

receiving, by the video hosting server, a video file uploaded to the video hosting server from a client device of a user, the video file including video content combined with audio content prior to being uploaded to the video hosting server;

processing the audio content to determine whether the audio content is unlicensed audio content that is owned by a known content owner other than the user that uploaded the video file;

responsive to the audio content being unlicensed audio content;

removing the unlicensed audio content from the video file; and

storing the video file at the video hosting server without the unlicensed audio content; and

responsive to receiving a request from another client device to play the video file, providing the stored video file without the unlicensed audio content to the other client device for playback.

2. The method of claim 1, wherein processing the audio content comprises:

generating a signature for the video file;

comparing the signature for the video file with signatures of licensed audio content from known content owners; and

determining a signature of a licensed audio content that matches the signature for the video file.

3. The method of claim 2, further comprising:

responsive to determining that the signature for the video file does not match a signature from the signatures of licensed audio content;

generating an audio fingerprint from spectral content of the video file;

comparing the audio fingerprint for the video file with audio fingerprints of licensed audio content from known content owners; and

determining an audio fingerprint of a licensed audio content that matches the audio fingerprint for the video file.

4. The method of claim 1, wherein the video content included in the video file is owned by the user that uploaded the video file.

5. The method of claim 1, wherein removing the unlicensed audio content from the video file responsive to the audio content being an unlicensed audio content comprises:

identifying a policy of the content owner that describes how to handle the unlicensed audio content; and

removing the unlicensed audio content responsive to the policy indicating to block the audio file.

6. The method of claim 1, further comprising:

sending a notification to the user, the notification indicating that the audio content included in the uploaded video file is an unlicensed audio content and options for editing the uploaded video file.

7. The method of claim 6, wherein removing the unlicensed audio content from the video file comprises:

removing the unlicensed audio content after a threshold amount of time responsive to the user failing to edit the uploaded video file according to the options included in the notification.

8. The method of claim 6, wherein the options for editing the uploaded video file include muting the audio file, replacing the audio file with a licensed audio file, and removing the audio file.

9. A video hosting server for managing the playback of video files stored on the video hosting server, the video files containing audio content, the video hosting server comprising:

a processor; and

a computer-readable storage medium storing executable code, the code when executed by the processor performs steps comprising;

receiving, by the video hosting server, a video file uploaded to the video hosting server from a client device of a user, the video file including video content combined with audio content prior to being uploaded to the video hosting server;

processing the audio content to determine whether the audio content is unlicensed audio content that is owned by a known content owner other than the user that uploaded the video file;

responsive to the audio content being unlicensed audio content;

removing the unlicensed audio content from the video file; and

storing the video file at the video hosting server without the unlicensed audio content; and

responsive to receiving a request from another client device to play the video file, providing the stored video file without the unlicensed audio content to the other client device for playback.

10. The system of claim 9, wherein removing the unlicensed audio content from the video file responsive to the audio content being an unlicensed audio content comprises:

identifying a policy of the content owner that describes how to handle the unlicensed audio content; and

removing the unlicensed audio content responsive to the policy indicating to block the audio file.

11. The system of claim 9, wherein the code when executed by the processor performs further steps comprising:

sending a notification to the user, the notification indicating that the audio content included in the uploaded video file is an unlicensed audio content and options for editing the uploaded video file.

12. The system of claim 11, wherein removing the unlicensed audio content from the video file comprises:

removing the unlicensed audio content after a threshold amount of time responsive to the user failing to edit the uploaded video file according to the options included in the notification.

13. The system of claim 11, wherein the options for editing the uploaded video file include muting the audio file, replacing the audio file with a licensed audio file, and removing the audio file.

14. The system of claim 11, wherein processing the audio content comprises:

generating a signature for the video file;

comparing the signature for the video file with signatures of licensed audio content from known content owners; and

determining a signature of a licensed audio content that matches the signature for the video file.

15. A computer program product comprising a non-transitory computer-readable storage medium storing executable code for managing the playback of video files stored on a video hosting server, the video files containing audio content, the code when executed performs steps comprising:

receiving a video file uploaded from client device of a user of the video hosting server, the video file uploaded to the video hosting website from a client device of a user, the video file including video content combined with audio content prior to being uploaded to the video hosting server;

processing the audio content to determine whether the audio content is unlicensed audio content that is owned by a known content owner other than the user that uploaded the video file;

responsive to the audio content being unlicensed audio content;

removing the unlicensed audio content from the video file; and

storing the video file at the video hosting server without the unlicensed audio content; and

responsive to receiving a request from another client device to play the video file, providing the video file without the unlicensed audio content to the other client device for playback.

16. The computer program product of claim 15, wherein removing the unlicensed audio content from the video file responsive to the audio content being an unlicensed audio content comprises:

identifying a policy of the content owner that describes how to handle the unlicensed audio content; and

removing the unlicensed audio content responsive to the policy indicating to block the audio file.

17. The computer program product of claim 15, wherein the code when executed by the performs further steps comprising:

sending a notification to the user, the notification indicating that the audio content included in the uploaded video file is an unlicensed audio content and options for editing the uploaded video file.

18. The computer program product of claim 15, wherein removing the unlicensed audio content from the video file comprises:

removing the unlicensed audio content after a threshold amount of time responsive to the user failing to edit the uploaded video file according to the options included in the notification.

19. The computer program product of claim 17, wherein the options for editing the uploaded video file include muting the audio file, replacing the audio file with a licensed audio file, and removing the audio file.

20. The computer program product of claim 15, wherein processing the audio content comprises:

generating a signature for the video file;

comparing the signature for the video file with signatures of licensed audio content from known content owners; and

determining a signature of a licensed audio content that matches the signature for the video file.