System and method for using a list of audio media to create a list of audiovisual media

• US 8,798,777 B2
• Filed: 03/08/2011
• Issued: 08/05/2014
• Est. Priority Date: 03/08/2011
• Status: Active Grant

• Current Assignee: III Holdings 2, LLC
• Original Assignee: PacketVideo Corporation (Nippon Telegraph and Telephone Corporation)
• Inventors: Mundy, L. Starlight, Wilkens, Dann, Sanini, Christina, Neff, Ralph, Rolfe, Joel
• Primary Examiner(s): MCCORD, PAUL C
• Application Number:
  US12/932,882
• Publication Number:
  US 20120232681A1
• Time in Patent Office: 1,246 Days
• Field of Search: 700/94
• US Class Current: 700/94
• CPC Class Codes: G06F 16/4387 by the use of playlists
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06F 16/7834 using audio features

Abstract

A system and a method use a list of audio media to create a list of audiovisual media. A user of a computing device may create, may access, may edit and/or may use a list of audio media objects, such as, for example, an audio playlist. The the user may request generation of a list of audiovisual media objects which correspond to the audio media objects in the list of audio media objects. The user may request generation of the list of audiovisual media objects using a user interface on the computing device. The list of audio media objects may be provided to a list conversion engine which may discover, create, and/or obtain audiovisual media objects which correspond to the audio media objects in the list of audio media objects.

Claims

1. A method for using a list of two or more audio media objects to create a list of audiovisual media objects, the method comprising the steps of:

analyzing the list of audio media objects to obtain metadata descriptive of the audio media objects;

searching one or more visual media object databases using the metadata wherein each of the visual media object databases provides access to visual media objects which encode visual content;

identifying a set of visual media objects wherein each of the visual media objects in the set corresponds to one of the audio media objects in the list of audio media objects wherein the set of visual media objects is identified based on the searching step without user input selecting the visual media objects in the set;

using the set of visual media objects to create the list of audiovisual media objects wherein each of the audiovisual media objects referenced by the list of audiovisual media objects corresponds to one of the audio media objects in the list of audio media objects;

playing the audio media objects using the list of audio media objects wherein a user of a computing device controls the playing of the audio media objects using a user interface of the computing device;

accepting user input on the computing device wherein the list of audiovisual media objects is created in response to the user input;

and playing the audiovisual media objects of the list of audiovisual media objects using a rendering device which is a different device than the computing device wherein the computing device stops playing the audio media objects and instructs the rendering device to begin playing the audiovisual media objects without additional user input requesting playback of the audiovisual media objects subsequent to the user input which prompts creation of the list of audiovisual media objects.

2. Claim 1 further comprising the step of:

accepting user input on a computing device from a user of the computing device wherein the list of audiovisual media objects is created in response to the user input.

3. The method of claim 1 wherein each of the audio media objects referenced by the list of audio media objects corresponds to one of the audiovisual media objects in the list of audiovisual media objects.

4. The method of claim 1 wherein the step of analyzing the list of audio media objects comprises the steps of:

identifying a first audio media object referenced by the list of audio media objects;

accessing the first audio media object; and

extracting a metadata field from the first audio media object wherein the metadata field is included in the metadata used in the searching step.

5. The method of claim 1 wherein one of the one or more visual media object databases is a database of professionally produced music videos.

6. The method of claim 1 wherein one of the one or more visual media object databases is a video sharing service which provides access to fan videos.

7. The method of claim 1 wherein one of the one or more visual media object databases is a database which provides access to digital photographs uploaded by users.

8. The method of claim 1 further comprising the step of:

using the metadata of a first audio media object referenced by the list of audio media objects to identify a first visual media object and a second visual media object which correspond to the first audio media object wherein the first visual media object is available from a first visual media object database and the second visual media object is available from a second visual media object database wherein the first visual media object is used to create the list of audiovisual media and the second visual media object is not used to create the list of audiovisual media objects based on a predetermined preference for the first visual media object database over the second visual media object database.

9. The method of claim 1 wherein one of the audiovisual media objects in the list of audiovisual media objects is one of the visual media objects in the set of visual media objects.

10. The method of claim 1 wherein each of the audio media objects referenced by the list of audio media objects does not encode visual content.

11. The method of claim 1 further comprising the step of:

obtaining the audiovisual media objects referenced by the list of audiovisual media objects wherein the computing device uses the list of audiovisual media objects to obtain the audiovisual media objects and further wherein the computing device stores the audiovisual media objects on a storage medium after obtaining the audiovisual media objects.

12. The method of claim 1 wherein a first audiovisual media object in the list of audiovisual media objects is obtained from a first content provider and further wherein a second audiovisual media object in the list of audiovisual media objects is obtained from a second content provider which is a different content provider than the first content provider.

13. The method of claim 1 wherein the list of audiovisual media objects is provided to the user of the computing device as a playlist file.

14. The method of claim 1 further comprising the steps of:

displaying the list of audiovisual media objects to a user of a computing device;

accepting user input on the computing device after displaying the list of audiovisual media objects; and

playing the audiovisual media objects using the list of audiovisual media objects wherein playing the audiovisual media objects is initiated in response to the user input and further wherein playing the audiovisual media objects involves rendering the audiovisual media objects using one of the computing device and an external rendering device.

15. The method of claim 1 further comprising the step of:

using a web page to upload the list of audio media objects to a video media provider located remotely relative to the computing device wherein the video media provider creates the list of audiovisual media objects.

16. The method of claim 1 further comprising the step of:

creating the list of audio media objects using a web page provided by an online content service wherein the online content service uses the list of audio media objects to create the list of audiovisual media objects.

17. The method of claim 1 further comprising the step of:

storing the list of audiovisual media objects in a playlist file having a first audiovisual media object corresponding to a first audio media object referenced by the list of audio media objects wherein an alternative audiovisual media object corresponding to the first audio media object is encoded using comment fields in the playlist file.

18. The method of claim 1 further comprising the steps of:

combining audio content from one of the audio media objects referenced by the list of audio media objects with visual content from at least one of the visual media objects from the set of visual media objects to produce a new audiovisual media object; and

including a reference to the new audiovisual media object in the list of audiovisual media objects.

19. The method of claim 1 wherein the audio media objects referenced by the list of audio media objects are digital music tracks.

20. The method of claim 19 wherein the audiovisual media objects referenced by the list of audiovisual media objects are music videos which correspond to the digital music tracks.

21. A system for using a list of audio media objects to create a list of audiovisual media objects, the system comprising:

a computing device which plays audio media objects referenced by the list of audio media objects wherein a user of the computing device inputs a request for creation of the list of audiovisual media objects using a user interface provided by the computing device;

a list conversion engine which responds to the request by analyzing the list of audio media objects to obtain metadata descriptive of the audio media objects wherein the list conversion engine uses the metadata to search a visual media object database which provides access to visual media objects which encode visual content;

and a set of visual media objects identified by the list conversion engine wherein each of the visual media objects in the set corresponds to one of the audio media objects in the list of audio media objects and further wherein the list of audiovisual media objects is created by the list conversion engine using the set of visual media objects wherein each of the audiovisual media objects in the list of audiovisual media objects corresponds to one of the audio media objects referenced by the list of audio media objects;

further comprising playing the audio media objects using the list of audio media objects wherein a user of the computing device controls the playing of the audio media objects using the user interface of the computing device;

accepting user input on the computing device wherein the list of audiovisual media objects is created in response to the user input;

and playing the audiovisual media objects of the list of audiovisual media objects using a rendering device which is a different device than the computing device wherein the computing device stops playing the audio media objects and instructs the rendering device to begin playing the audiovisual media objects without additional user input requesting playback of the audiovisual media objects subsequent to the user input which prompts creation of the list of audiovisual media objects.

22. The system of claim 21 wherein the list conversion engine is at least partially provided by an application executed by the computing device.

23. The system of claim 21 wherein the list conversion engine is accessed by the computing device using a network to which the computing device is connected.

24. The system of claim 21 further comprising:

a web page provided by a media service remotely located relative to the computing device wherein the computing device accesses the list conversion engine over a network using the web page provided by the media service.

25. The system of claim 21 wherein the user of the computing device uses the list of audiovisual media objects to render the audiovisual media objects referenced by the list of audiovisual media objects on a DLNA-compliant television in communication with the computing device over a home network.

26. A method for using a list of two or more audio media objects to create a list of two or more audiovisual media objects, the method comprising the steps of:

for each audio media object in the list of audio media objects;

obtaining metadata descriptive of the audio media object;

searching one or more visual media object databases using the metadata, wherein the searching identifies a set of visual media objects which correspond to the audio media object;

and determining an audiovisual media object for inclusion in the list of audiovisual media objects wherein the audiovisual media object is determined based on examining properties of the visual media objects which correspond to the audio media object;

creating a list of audiovisual media objects wherein the list references each of the audiovisual media objects determined in the determining step;

and displaying the list of audiovisual media objects to a user of a computing device;

further comprising playing the audio media objects using the list of audio media objects wherein a user of a computing device controls the playing of the audio media objects using a user interface of the computing device;

accepting user input on the computing device wherein the list of audiovisual media objects is created in response to the user input;

and playing the audiovisual media objects of the list of audiovisual media objects using a rendering device which is a different device than the computing device wherein the computing device stops playing the audio media objects and instructs the rendering device to begin playing the audiovisual media objects without additional user input requesting playback of the audiovisual media objects subsequent to the user input which prompts creation of the list of audiovisual media objects.

27. The method of claim 26 wherein the obtaining step analyzes a playlist file to extract the metadata from the playlist file.

28. The method of claim 26 wherein the obtaining step examines at least one audio media object to extract the metadata from the audio media object.

29. The method of claim 26 wherein the list of audio objects references N audio objects wherein the list of audiovisual objects references N audiovisual objects wherein for each I in [1 . . . N], the Ith audiovisual object in the list of audiovisual objects corresponds to the Ith audio object in the list of audio objects.

30. The method of claim 26 further comprising the step of:

presenting within the displayed list an interactive control associated with a first audiovisual media object of the list of audiovisual media objects wherein the interactive control allows the user to access a list of alternative audiovisual media objects and to select one of the alternative audiovisual media objects to replace the first audiovisual media object in the list of audiovisual media objects.

31. The method of claim 26 wherein the determining step for at least one of the audio media objects involves selecting one of the visual media objects to be the audiovisual media object for inclusion in the list of audiovisual media objects.

32. The method of claim 26 wherein the examined properties include at least one of a number of times the visual media object has been viewed and a rating for the visual media object.

33. The method of claim 26 wherein the determining step for at least one of the audio media objects involves detecting that a first visual media object has a restriction indication and selecting the first visual media object to be the audiovisual media object for inclusion in the list of audiovisual media objects at least partly on the basis of detecting the restriction indication.

34. The method of claim 26 wherein the determining step for at least one of the audio media objects involves combining visual content from at least one of the visual media objects with audio content from the audio media object to produce a new audiovisual media object wherein the new audiovisual media object is the audiovisual media object for inclusion in the list of audiovisual media objects.

35. The method of claim 26 wherein the determining step for at least one of the audio media objects involves processing audio content of the audio media object to produce a visualization animation for the audio media object and creating a new audiovisual media object based on the visualization animation wherein the new audiovisual media object is the audiovisual media object for inclusion in the list of audiovisual media objects.

36. The method of claim 26 wherein the determining step for at least one of the audio media objects involves creating an image which displays text information descriptive of the audio media object and combining the image with audio content from the audio media object to create a new audiovisual media object wherein the new audiovisual media object is created based on determining that the set of visual media objects which correspond to the audio media object is an empty set.