Automapping of music tracks to music videos

• US 9,971,773 B2
• Filed: 07/15/2016
• Issued: 05/15/2018
• Est. Priority Date: 03/04/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Cirrincione, Cory, Sachidanandam, Vignesh, Savchenko, Alex
• Primary Examiner(s): Boccio, Vincent F
• Application Number:
  US15/211,494
• Publication Number:
  US 20170011033A1
• Time in Patent Office: 669 Days
• Field of Search: 707722, 707738, 707769
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/4387 by the use of playlists
• CPC Class Codes: G06F 16/635 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/735 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/26258 for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/278 Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/8113 comprising music, e.g. song in MP3 format

Abstract

A music service remote from a local device user identifies matching video and music content. An identification of a piece of media content that is part of a collection or playlist, is received by the service, the selected piece of media content being included in a unified catalog of video and music content that is accessible by the music service. If the selected piece of media content has a matching member in the unified catalog, the matching member replaces the selected piece of media content during playback of the collection on the local device. The service analyzes a collection of media content associated with the user, the content collection being either i) stored locally on the local device, or ii) stored remotely from the local device in a store that is accessible by the music service, or iii) stored using a combination of local and remote storage.

Claims

1. A method of remotely providing a music service that identifies matching video and music content to a user at a local client device, comprising:

analyzing a collection of media content associated with the user, the media content collection being either i) stored locally on the local client device, ii) stored remotely from the local client device in a store that is accessible by the music service, or) stored using a combination of local and remote storage;

receiving a playlist from the user at the local client device, the playlist identifying media content items including video content members from the user'"'"'s collection of media content and further identifying a playback order of the media content items on the local client device;

receiving an identification of a media content item associated with the user at the local client device, the selected media content item being a video content item included in a unified catalog of video content items and audio content items that is accessible by the music service, portions of the unified catalog having two matching media content items in which one of the matching media content items is a video content item and another of the matching members is an audio content item;

retrieving from the unified catalog an identification of a matching audio content item to the identified video content item; and

during runtime dynamically replacing the video content item in the playlist with the matching audio content item.

2. The method of claim 1 in which matching members share at least one matching criteria, the matching criteria including at least title.

3. The method of claim 1 further including performing the replacing during runtime of the playlist playback on the local client device.

4. The method of claim 1 further including providing a media content marketplace that is browsable by the user at the local client device, the media content marketplace offering media content from the unified catalog for consumption by the user at the local client device.

5. The method of claim 4 further including

receiving input from the user at the local client device comprising browsing commands for navigating the media content marketplace and making selections of particular pieces of media content from the unified catalog, and

responsively to the received input, displaying at least one matching member to the selected media content to the user at the local client device.

6. An apparatus, comprising:

one or more processors;

a display that supports a user interface (UI); and

a hardware memory device storing computer-readable instructions which, when executed by the one or more processors, cause the apparatus to;

capture an input from the user that identifies a piece of media content, the piece of media content being video content,

send the captured input to a remote service for processing, the processing including searching a unified catalog of video and music content that is accessible by the remote service, portions of the unified catalog having two matching members in which one of the matching members is video content and another of the matching members is audio content,

receive from the remote service, an identification of audio content being a matching member to the identified piece of video content, and

use the identification of the matching member in a presentation supported on the UI as part of the user experience, wherein the matching member dynamically replaces the piece of video content with matching audio content during playback of a collection of a plurality of media content items that includes the piece of video content.

7. The apparatus of claim 6 in which the captured input pertains to an action performed by the user for one of creating a playlist, making a playlist, or browsing an online catalog of media content.

8. The apparatus of claim 7 further wherein the computer-readable instructions when executed by the one or more processors cause the apparatus to arrange the presentation to display media content from the unified catalog that is available for consumption by the user using the apparatus.

9. The apparatus of claim 8 further wherein the computer-readable instructions when executed by the one or more processors cause the apparatus to configure the presentation to show the playlist of media content on the UI, the UI supporting at least one of:

i) iconography to indicate those pieces of media content in the playlist which comprise audio content and those pieces of media content in the playlist which comprise video content, or, ii) a presentation form that indicates availability of media content as video.

10. The apparatus of claim 8 wherein the computer-readable instructions when executed by the one or more processors cause the apparatus to configure the presentation to show the browsable online catalog on the GUI, the GUI including iconography to indicate those pieces of media content in the catalog which comprise audio content and those pieces of media content in the playlist which comprise video content.

11. The apparatus of claim 10 further wherein the computer-readable instructions when executed by the one or more processors cause the apparatus to include one of:

i) provide a control for the user to selectively control whether available video content is displayed in the presentation, or ii) configure video content availability according to a form factor of the apparatus.

12. The apparatus of claim 10 further wherein the computer-readable instructions when executed by the one or more processors cause the apparatus to receive a selection from the user of a piece of media content for playback on the apparatus and playing the selected piece of media content.

13. The apparatus of claim 6 further including an optical sensor for capturing the input as one or more observed gestures performed by the user.

14. The apparatus of claim 6 in which matching members in the unified catalog share at least one matching criteria, the matching criteria including at least title.

15. A hardware memory device including computer-readable instructions which, when executed by one or more processors in an electronic device, cause the device to:

access a unified catalog of video and music content, portions of the unified catalog having two matching members in which one of the matching members is video content and another of the matching members is audio content, the members being matched when sharing common criteria including content title or content name;

search the unified catalog to locate a matching member to a given piece of media content, the given piece of media content being either audio content or video content and being part of a collection of media content comprising a plurality of media content items specified by a user;

if a matching member to the given piece of media content is located, identify the located matching member;

use the identification to replace the given piece of media content with the located matching member during playback of the collection of media content,

wherein the given piece of media content comprises video content and matching audio content is utilized to replace the video content dynamically during playback of the collection of media content so that the audio content plays in lieu of the video content.

16. The hardware memory device of claim 15 in which matching members share at least one matching criteria, the matching criteria including at least title.

17. The hardware memory device of claim 15 wherein the computer-readable instructions when executed by the one or more processors cause the device to

receive an input from the user that indicates a selection of a piece of audio content, and

use the identification to populate matching video content into a graphical user interface (GUI) accessible by the user.

18. The hardware memory device of claim 17 wherein the computer-readable instructions when executed by the one or more processors cause the device to populate additional related information pertaining to the matching video content in the GUI, the additional related information including at least one of album, artist, or other media content by the artist.

19. The hardware memory device of claim 15 further wherein the computer-readable instructions when executed by the one or more processors cause the electronic device to include one of:

i) provide a control for the user to selectively control whether available video content is displayed in the presentation, or ii) configure video content availability according to a form factor of the apparatus.

20. The hardware memory device of claim 15 further wherein the computer-readable instructions when executed by the one or more processors cause the electronic device to receive a selection from the user of a piece of media content for playback on the device and playing the selected piece of media content.