Site directed management of audio components of uploaded video files

• US 8,301,658 B2
• Filed: 02/13/2007
• Issued: 10/30/2012
• Est. Priority Date: 11/03/2006
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Chastagnol, Franck, Karunamurthy, Vijay, Liu, Matthew, Maxcy, Christopher
• Primary Examiner(s): Perveen, Rehana
• Assistant Examiner(s): Wong, Huen
• Application Number:
  US11/674,639
• Publication Number:
  US 20090144326A1
• Time in Patent Office: 2,086 Days
• Field of Search: 707/705, 707/736, 707/783, 707/914, 707/916, 707/944, 713/176, 726/26
• US Class Current: 707/783
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/64 Browsing; Visualisation therefor generation of a list or set of audio data G06F16/638
• CPC Class Codes: G06F 16/686 using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 21/1015 to users
• CPC Class Codes: G06F 21/105 Arrangements for software license management or administration, e.g. for managing licenses at corporate level
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4542 Blocking scenes or portions of the received content, e.g. censoring scenes
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: Y10S 707/914 Video
• CPC Class Codes: Y10S 707/916 Audio
• CPC Class Codes: Y10S 707/944 Business related

Abstract

A system, method and various software tools enable a video hosting website to automatically identified unlicensed audio content in video files uploaded by users, and initiate a process by which the user can replace the unlicensed content with licensed audio content. An audio replacement tool is provided that enables the user to permanently mute the original, unlicensed audio content of a video file, or select a licensed audio file from a collection of licensed audio, and insert the selected in place of the original audio.

Claims

1. A computer-implemented method of identifying and replacing unlicensed audio content in video files uploaded to a video hosting website, the method comprising:

receiving a video file uploaded from a user at a video hosting website, the video file including audio content;

responsive to receiving the video file uploaded from the user, processing the audio content to determine whether the audio content is unlicensed for use on the video hosting website;

prior to publishing the video file on the video hosting website, performing;

responsive to the audio content being an unlicensed audio content;

providing to the user a list of selectable licensed audio files accessed from the video hosting website, wherein the selectable licensed audio files are licensed in a manner that allows for use of the selectable licensed audio files on the video hosting website;

receiving, from the user, a selection of a licensed audio file from the list of selectable licensed audio files;

receiving from the user an instruction to replace the audio content included in the video file with the user selected licensed audio file; and

publishing the video file to make the video file accessible to other users of the video hosting website.

2. The method of claim 1, further comprising:

responsive to receiving from the user the instruction to replace the audio content included in the video file, removing the unlicensed audio content from the video file, and inserting the user selected licensed audio file.

3. The method of claim 2, further comprising:

displaying a video playback page for the video file, the video file including the user selected licensed audio file;

displaying on the video playback page attribution information for the user selected licensed audio file; and

displaying on the video playback page a hyperlink to an e-commerce site from which the user selected licensed audio file can be purchased.

4. The method of claim 1, wherein the list includes freely available audio content, from which the user can select audio content to replace the unlicensed audio content.

5. The method of claim 1, wherein receiving from the user the instruction to replace the audio content included in the video file further comprises:

executing an audio replacement tool that enables the user to select the licensed audio file.

6. The method of claim 5, wherein executing an audio replacement tool further comprises:

executing the audio replacement tool as a hosted application on the video hosting website.

7. The method of claim 5, wherein executing an audio replacement tool comprises:

executing the audio replacement tool as an application in client device of the user.

8. The method of claim 5, wherein the audio replacement tool is a closed audio replacement tool with access only to audio content licensed for use on the video hosting website.

9. The method of claim 5, wherein the audio replacement tool is configured to allow the user to select only a single licensed audio file to replace the unlicensed audio content.

10. The method of claim 5, wherein the audio replacement tool is configured to allow the user to select at least two licensed audio files to replace the unlicensed audio content, and to mix the selected licensed audio files.

11. The method of claim 5, wherein the audio replacement tool is configured to allow the user to record audio content from a client device to replace the unlicensed audio content.

12. The method of claim 1, further comprising:

responsive to the audio content being an unlicensed audio content, notifying the user of the unlicensed audio content.

13. The method of claim 1, further comprising:

responsive to the audio content being an unlicensed audio content, setting the video file to instruct a video player to automatically mute the audio content when the video file is played back.

14. The method of claim 1, further comprising:

responsive to the audio content being an unlicensed audio content, receiving from the user an instruction to permanently mute the audio content of the video file.

15. The method of claim 14, further comprising:

responsive to receiving from the user an instruction to permanently mute the audio content of the video file, removing the audio content of the video file.

16. The method of claim 1, further comprising:

responsive to the audio content being an unlicensed audio content, receiving from the user an instruction to remove the video file so as to prevent playback of the video.

17. The method of claim 1, further comprising:

receiving a plurality of video files being uploaded by a user at the video hosting site.

18. The method of claim 1, wherein processing the audio content comprises:

generating a file signature from the video file containing the audio content; and

matching the file signature with the file signatures of licensed audio content from known content owners.

19. The method of claim 1, wherein processing the audio content comprises:

generating an audio fingerprint from the spectral content of the video file containing the audio content; and

matching the audio fingerprint with the audio fingerprints of licensed audio content from known content owners.

20. The method of claim 1, wherein processing the audio content further comprises:

determining a revenue sharing policy of the content owner for the unlicensed audio content; and

responsive to the revenue policy, determining whether to block the unlicensed audio content or allow the unlicensed audio content.

21. A computer implemented method of editing a video file in a video hosting website, the video uploaded to the site by a user, the method comprising:

receiving a video file uploaded from the user at the video hosting website, the video file including audio content;

responsive to receiving the video file uploaded from the user, processing the audio content to determine whether the audio content is unlicensed for use on the video hosting website;

prior to publishing the video file on the video hosting website, performing;

responsive to the audio content being an unlicensed audio content;

executing an audio replacement tool, the audio replacement tool operating on the video file, the video file including the audio content;

providing, within the audio replacement tool, a list of selectable licensed audio files accessed from the video hosting website to the user, wherein the selectable licensed audio files are licensed in a manner that allows for use of the selectable licensed audio files on the video hosting website;

receiving, from the user, a selection of a licensed audio file from the list of selectable licensed audio files;

replacing the audio content in the video file with the selected license audio file;

storing the video file with the selected licensed audio file selected by the user; and

publishing the video file to make the video file accessible to other users of the video hosting website.

22. A video hosting computer system for hosting a video hosting website, the system comprising:

an ingest server configured to receive from a user client device an uploaded video file, the video file containing audio content;

a video database configured to receive from the ingest server the uploaded video file, and provide access to the uploaded video file in response to a playback request;

a rights management system coupled to the ingest server configured to receive the uploaded video file and configured to determine whether the audio content in the video file is unlicensed for use on the video hosting website responsive to receiving the uploaded video file;

a licensed audio content database comprising licensed audio content; and

an audio replacement tool coupled to the video database configured to, responsive to the audio content being an unlicensed audio content and prior to publishing the video file on the video hosting website, provide, to the user client device, a list of the selectable licensed audio files from the licensed audio content database that are licensed in a manner that allows for use of the selectable licensed audio files on the video hosting website, receive a selection of one of the licensed audio files from the list from the user client device, replace the audio content of the video file with the selected licensed audio file, store the video file with the licensed audio file in the video database, and provide a mechanism for publishing the video file to make the video file accessible to other users of the video hosting website.

23. An audio replacement tool stored on a non-transitory computer-readable storage medium and executed by a video hosting computer system, the audio replacement tool configured to interoperate with the video hosting computer system, and comprising:

computer-executable code stored on the non-transitory computer-readable storage medium that when executed by the video hosting computer system responsive to the video hosting computer system receiving a video file from a user comprising audio content that is unlicensed for use on the video hosting computer system and prior to the video hosting computer system publishing the video file on a video hosting website generates;

a display area for displaying the video file to the user, the video file including the audio content that is unlicensed for use on the video hosting computer system; and

an audio content listing area for displaying to the user a list of a plurality of selectable licensed audio files retrieved to replace the unlicensed audio content responsive to determining that the audio content is unlicensed for use on the video hosting computer system, the list of the plurality of selectable licensed audio files received from the video hosting computer system and wherein the plurality of selectable licensed audio files in the list are licensed in a manner that allows for use of the plurality of selectable licensed audio files on the video hosting computer system;

means for receiving, from the user, a selection of one of the plurality of selectable licensed audio files from the list displayed in the listing area;

a video and audio encoder configured to receive the selected audio file selected by the user and replace the unlicensed audio content with selected audio file by encoding the selected audio content into the video file; and

means for publishing the video file to make the video file accessible to other users of the video hosting computer system.