AUTOMAPPING OF MUSIC TRACKS TO MUSIC VIDEOS

• US 20170011033A1
• Filed: 07/15/2016
• Published: 01/12/2017
• Est. Priority Date: 03/04/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Cirrincione, Cory, Sachidanandam, Vignesh, Savchenko, Alex
• Granted Patent: US 9,971,773 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/4387 by the use of playlists
• CPC Class Codes: G06F 16/635 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/735 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/26258 for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/278 Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/8113 comprising music, e.g. song in MP3 format

Abstract

A music service remote from a local device user identifies matching video and music content. An identification of a piece of media content that is part of a collection or playlist, is received by the service, the selected piece of media content being included in a unified catalog of video and music content that is accessible by the music service. If the selected piece of media content has a matching member in the unified catalog, the matching member replaces the selected piece of media content during playback of the collection on the local device. The service analyzes a collection of media content associated with the user, the content collection being either i) stored locally on the local device, or ii) stored remotely from the local device in a store that is accessible by the music service, or iii) stored using a combination of local and remote storage.

Claims

1. A method of remotely providing a music service that identifies matching video and music content to a user at a local client device, comprising:

receiving an identification of a piece of media content associated with the user at the local client device, the selected piece of media content being included in a unified catalog of video and music content that is accessible by the music service, portions of the unified catalog having two matching members in which one of the matching members is video content and another of the matching members is audio content;

retrieving from a unified catalog, an identification of a matching member to the piece of media content; and

using the retrieved identification of the matching member to the piece of media content to provide a user experience for the user at the local client device.

2. The method of claim 1 in which matching members share at least one matching criteria, the matching criteria including at least title.

3. The method of claim 1 further including analyzing a collection of audio content associated with the user, the audio content collection being either i) stored locally on the local client device, ii) stored remotely from the local client device in a store that is accessible by the music service, or) stored using a combination of local and remote storage.

4. The method of claim 3 further including receiving a playlist from the user at the local client device, the playlist identifying audio content items from the user'"'"'s collection of audio content and further identifying a playback order of the audio content items on the local client device.

5. The method of claim 4 further including replacing an audio content item in the playlist with matching video content.

6. The method of claim 4 further including performing the replacing during runtime of the playlist playback on the local client device.

7. The method of claim 1 further including providing a media content marketplace that is browsable by the user at the local client device, the media content marketplace offering media content from the unified catalog for consumption by the user at the local client device.

8. The method of claim 1 further including

receiving input from the user at the local client device comprising browsing commands for navigating the media content marketplace and making selections of particular pieces of media content from the unified catalog, and

responsively to the received input, displaying at least one matching member to the selected media content to the user at the local client device.

9. An apparatus, comprising:

one or more processors;

a display that supports a user interface (UI); and

a memory device storing computer-readable instructions which, when executed by the one or more processors, perform a method for generating a user experience for a user of the apparatus, the method comprising;

capturing an input from the user that identifies a piece of media content, the piece of audio content being either audio content or video content,

sending the captured input to a remote service for processing, the processing including searching a unified catalog of video and music content that is accessible by the remote service, portions of the unified catalog having two matching members in which one of the matching members is video content and another of the matching members is audio content,

receiving from the remote service, an identification of a matching member to the piece of media content,

using the identification of the matching member in a presentation supported on the UI as part of the user experience.

10. The apparatus of claim 9 in which the captured input pertains to an action performed by the user for one of creating a playlist, making a playlist, or browsing an online catalog of media content.

11. The apparatus of claim 10 further including arranging the presentation to display media content from the unified catalog that is available for consumption by the user using the apparatus.

12. The apparatus of claim 11 further including configuring the presentation to show the playlist of media content on the UI, the UI supporting at least one of:

i) iconography to indicate those pieces of media content in the playlist which comprise audio content and those pieces of media content in the playlist which comprise video content, or, ii) a presentation form that indicates availability of media content as video.

13. The apparatus of claim 11 further including configuring the presentation to show the browsable online catalog on the GUI, the GUI including iconography to indicate those pieces of media content in the catalog which comprise audio content and those pieces of media content in the playlist which comprise video content.

14. The apparatus of claim 13 further including one of:

i) providing a control for the user to selectively control whether available video content is displayed in the presentation, or ii) configuring video content availability according to a form factor of the apparatus.

15. The apparatus of claim 9 further including receiving a selection from the user of a piece of media content for playback on the apparatus and playing the selected piece of media content.

16. The apparatus of claim 9 further including an optical sensor for capturing the input as one or more observed gestures performed by the user.

17. A memory device including computer-readable instructions which, when executed by one or more processors in an electronic device, perform a method comprising:

accessing a unified catalog of video and music content, portions of the unified catalog having two matching members in which one of the matching members is video content and another of the matching members is audio content, the members being matched when sharing common criteria including content title or content name;

searching the unified catalog to locate a matching member to a given piece of media content, the given piece of media content being either audio content or video content and being part of a collection of media content that is specified by a user;

if a matching member to the given piece of media content is located, identifying the located matching member; and

using the identification to replace the given piece of media content with the located matching member during playback of the collection of media content.

18. The memory device of claim 17 in which the given piece of media content comprises audio content and matching video content is utilized to replace the audio content during playback of the collection of media content so that the video content plays in lieu of the audio content.

19. The memory device of claim 18 further including

receiving an input from the user that indicates a selection of a piece of video content,

using the identification to populate matching audio content into a graphical user interface (GUI) accessible by the user.

20. The memory device of claim 19 further including populating additional related information pertaining to the matching audio content in the GUI, the additional related information including at least one of album, artist, or other media content by the artist.