Method and an electronic device for performing playback of streamed media including related media content

• US 10,671,234 B2
• Filed: 06/24/2015
• Issued: 06/02/2020
• Est. Priority Date: 06/24/2015
• Status: Active Grant

• Current Assignee: Spotify AB (Spotify Technology SA)
• Original Assignee: Spotify AB (Spotify Technology SA)
• Inventors: Conway, Frank, Wood, Robert William, Suresh, Arvind, Schneider, Tobias Heinrich
• Primary Examiner(s): Pitaro, Ryan F
• Application Number:
  US14/749,512
• Publication Number:
  US 20160378269A1
• Time in Patent Office: 1,805 Days
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04L 65/1089 by adding media; by removing media
• CPC Class Codes: H04L 65/4025 where none of the additional parallel sessions is real time or time sensitive, e.g. downloading a file in a parallel FTP session, initiating an email or combinational services
• CPC Class Codes: H04L 65/612 for unicast

Abstract

Described herein are methods and electronic devices for performing playback of streamed media, including complementing a media content item with an associated media content item. In accordance with an exemplary embodiment, during playback of a first media content item, a message is sent to a computer server system, to return information that a related second media content item is selectable. The information that the second media content item is selectable is displayed at a user interface as a visual array of tiles, wherein each one of the tiles corresponds to a respective second media content item. Playback of the second media content item can be combined with the first media content item. By displaying information about selectable associated media content items to a user, the user will be enabled to individually select associated media content items to complement a currently playbacked media content item.

Claims

1. A method of operating an electronic device for performing playback of a streamed first media content item combined with a second media content item at a user interface of the electronic device, the method comprising:

during playback of the first media content item,

sending a first data message to a computer server system, the first data message comprising instructions to the computer server system to return an indication that one or more additional media content items associated with the first media content item are selectable, and

receiving a second data message from the computer server system, the second data message comprising the indication that the one or more additional media content items are selectable,

displaying, at the user interface, a plurality of tiles in a visual array, including a first tile associated with the currently played first media content item and one or more additional tiles visible behind the first tile,

wherein the one or more additional tiles are associated with the one or more additional media content items and provide the indication that the one or more additional media content items are selectable,

receiving, at the user interface, a first input at the first tile associated with the currently played first media content item, within the visual array, to cause display of one of the additional tiles visible behind the first tile, at the user interface, wherein the first input is interpreted as indicative of a selection of the one of the additional tiles visible behind the first tile, and wherein the selected additional tile is associated with a second media content item from within the one or more additional media content items,

receiving, at the user interface, a second input indicative of a request to receive the selected second media content item for playback,

in response to receiving the second input, sending, to the computer server system, a third data message comprising instructions to return the selected second media content item,

receiving a fourth data message from the computer server system, the fourth data message comprising the selected second media content item, and

performing playback of the selected second media content item combined with the first media content item at the user interface, including

determining a first media type of the first media content item and a second media type of the selected second media content item, and

based on the determined first media type and the determined second media type, controlling playback of the first media content item and the selected second media content item, including by continuing playback of the first media content item at one or more of a speaker or a display of the user interface, when performing playback of the selected second media content item.

2. The method of claim 1, wherein performing playback of the selected second media content item comprises at least one of:

playing the first media content item by a speaker of the user interface, and displaying the selected second media content item at a display of the user interface, and

displaying the first media content item at the display of the user interface, and displaying the selected second media content item at the display of the user interface.

3. The method of claim 1, wherein receiving the fourth data message comprises receiving the selected second media content item included in a media stream comprising the first media content item.

4. The method of claim 1, wherein the user interface comprises a touch-sensitive surface adapted to receive the first input and the second input, and wherein at least one of the first input and the second input comprises one or more of:

a swipe gesture, a tap gesture, and a click gesture.

5. The method of claim 4, wherein the one or more additional media content items comprises a plurality of additional media content items, and the method further comprises determining one of the plurality of additional media content items based on the first input.

6. The method of claim 5, further comprising adjusting a displayed ordering of the plurality of additional media content items, such that the determined one of the plurality of additional media content items is displayed at the display.

7. The method of claim 1, wherein the first media content item is a song, and the selected second media content item comprises one of:

lyrics, a music video, an image, a list comprising other recommended songs, an interview, information regarding an artist or information regarding the song, and a commercial offer.

8. The method of claim 1, wherein the first media content item is a video, and the selected second media content item comprises one of:

sub-titles, a song, an image, a list comprising recommended songs or videos, an interview, information regarding an artist or information regarding the video, and a commercial offer.

9. The method of claim 1, wherein a playback control is displayed at the user interface during playback of at least one of the first media content item or the selected second media content item.

10. A method of operating an electronic device for performing playback of a streamed first media content item at a user interface of the electronic device, and simultaneously delivering a service at the user interface, the method comprising:

during playback of the first media content item,

sending a first data message to a computer server system, the first data message comprising instructions to the computer server system to return an indication that one or more associated services associated with the first media content item are selectable, and

receiving a second data message from the computer server system, the second data message comprising the indication that the one or more associated services are selectable,

displaying, at the user interface, a plurality of tiles in a visual array, including a first tile associated with the currently played first media content item and one or more additional tiles visible behind the first tile,

wherein the one or more additional tiles are associated with the one or more associated services and provide the indication that the one or more associated services are selectable,

receiving, at the user interface, a first input at the first tile associated with the currently played first media content item, within the visual array, to cause display of one of the additional tiles visible behind the first tile, at the user interface, wherein the first input is interpreted as indicative of a selection of the one of the additional tiles visible behind the first tile, and wherein the selected additional tile is associated with a service from within the one or more associated services,

receiving, at the user interface, a second input indicative of a request to receive the selected service,

in response to receiving the second input, sending, to the computer server system, a request for service data of the selected service,

receiving, from the computer server system, the service data of the selected service in response to the request, and

delivering the selected service, by utilizing the received service data, combined with performing playback of the first media content item at the user interface, including

determining a media type of the first media content item and a service type of the selected service, and

based on the determined media type and the determined service type, controlling playback of the first media content item and delivery of the selected service, including by continuing playback of the first media content item at one or more of a speaker or a display of the user interface, when delivering the selected service.

11. The method of claim 10, wherein delivering the selected service comprises at least one of:

playing a game at the user interface,

displaying a commercial offer at the user interface,

displaying a fill-in-form, capturing a user input in the fill-in-form, and sending the user input to a service provider, and

capturing an image with a camera of the electronic device, and uploading the image to the computer server system.

12. An electronic device for performing playback of a streamed first media content item combined with a second media content item at a user interface of the electronic device, the electronic device comprising:

a user interface;

a processor; and

a memory storing computer program code, which, when run in the processor causes the electronic device to;

during playback of the first media content item,

send a first data message to a computer server system, the first data message comprising instructions to the computer server system to return an indication that one or more additional media content items associated with the first media content item are selectable, and

receive a second data message from the computer server system, the second data message comprising the indication that the one or more additional media content items are selectable,

display, at the user interface, a plurality of tiles in a visual array, including a first tile associated with the currently played first media content item and one or more additional tiles visible behind the first tile,

wherein the one or more additional tiles are associated with the one or more additional media content items and provide the indication that the one or more additional media content items are selectable,

receive, at the user interface, a first input at the first tile associated with the currently played first media content item, within the visual array, to cause display of one of the additional tiles visible behind the first tile, at the user interface, wherein the first input is interpreted as indicative of a selection of the one of the additional tiles visible behind the first tile, and wherein the selected additional tile is associated with a second media content item from within the one or more additional media content items,

receive, at the user interface, a second input indicative of a request to receive of the selected second media content item for playback,

in response to receiving the second input, send, to the computer server system, a third data message comprising instructions to return the selected second media content item,

receive a fourth data message from the computer server system, the fourth data message comprising the selected second media content item, and

perform playback of the selected second media content item combined with the first media content item at the user interface, including

determining a first media type of the first media content item and a second media type of the selected second media content item, and

based on the determined first media type and the determined second media type, controlling playback of the first media content item and the selected second media content item, including by continuing playback of the first media content item at one or more of a speaker or a display of the user interface, when performing playback of the selected second media content item.

13. The electronic device of claim 12, wherein the memory stores computer program code, which, when run in the processor causes the electronic device to perform playback of the selected second media content item by performing at least one of:

playing the first media content item by a speaker of the user interface, and displaying the selected second media content item at a display of the user interface, and

displaying the first media content item at the display of the user interface, and displaying the selected second media content item at the display of the user interface.

14. The electronic device of claim 12, wherein the memory stores computer program code, which, when run in the processor causes the electronic device to receive the fourth data message by receiving the selected second media content item included in a media stream comprising the first media content item.

15. The electronic device of claim 12, further comprising a touch-sensitive surface adapted to receive the first input and the second input, and wherein at least one of the first input and the second input comprises one or more of:

a swipe gesture, a tap gesture, and a click gesture.

16. The electronic device of claim 15, wherein the one or more additional media content items comprises a plurality of additional media content items, and the memory stores computer program code, which, when run in the processor causes the electronic device to determine one of the plurality of additional media content items based on the first input.

17. The electronic device of claim 16, wherein the memory stores computer program code, which, when run in the processor causes the electronic device to adjust a displayed ordering of the plurality of additional media content items, such that the determined one of the plurality of additional media content items is displayed at the display.

18. The electronic device of claim 12, wherein a playback control is displayed at the user interface during playback of at least one of the first media content item or the selected second media content item.

19. An electronic device for playback of a streamed first media content item at a user interface of the electronic device, and simultaneously delivering a service at the user interface, the first electronic device comprising:

a user interface;

a processor; and

a memory storing computer program code, which, when run in the processor causes the first electronic device to;

during playback of the first media content item,

send a first data message to a computer server system, the first data message comprising instructions to the computer server system to return an indication that one or more associated services associated with the first media content item are selectable, and

receive a second data message from the computer server system, the second data message comprising the indication that the one or more associated services are selectable, and in response thereto

display, at the user interface, a plurality of tiles in a visual array, including a first tile associated with the currently played first media content item and one or more additional tiles visible behind the first tile,

wherein the one or more additional tiles are associated with the one or more associated services and provide the indication that the one or more associated services are selectable,

receive, at the user interface, a first input at the first tile associated with the currently played first media content item, within the visual array, to cause display of one of the additional tiles visible behind the first tile, at the user interface, wherein the first input is interpreted as indicative of a selection of the one of the additional tiles visible behind the first tile, and wherein the selected additional tile is associated with a service from within the one or more associated services,

receive, at the user interface, a second input indicative of a request to receive the selected service,

in response to receiving the second input, send, to the computer server system, a request for service data of the selected service,

receive, from the computer server system, the service data of the selected service in response to the request, and

deliver the selected service, by utilizing the received service data, combined with performing playback of the first media content item at the user interface, including

determining a media type of the first media content item and a service type of the selected service, and

based on the determined media type and the determined service type, controlling playback of the first media content item and delivery of the selected service, including by continuing playback of the first media content item at one or more of a speaker or a display of the user interface, when delivering the selected service.

20. The electronic device of claim 19, wherein the memory stores computer program code, which, when run in the processor causes the electronic device to deliver the selected service by performing at least one of:

playing a game at the user interface,

displaying a commercial offer at the user interface,

displaying a fill-in-form, capturing a user input, and send the user input to a service provider, and

capturing an image with a camera of the electronic device, and uploading the image to the computer server system.

21. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with one or more processors, cause the electronic device to perform the method of

during playback of the first media content item,

sending a first data message to a computer server system, the first data message comprising instructions to the computer server system to return an indication that one or more additional media content items associated with the first media content item are selectable, and

receiving a second data message from the computer server system, the second data message comprising the indication that the one or more additional media content items are selectable,

displaying, at a user interface of the electronic device, a plurality of tiles in a visual array, including a first tile associated with the currently played first media content item and one or more additional tiles visible behind the first tile,

wherein the one or more additional tiles are associated with the one or more additional media content items and provide the indication that the one or more additional media content items are selectable,

receiving, at the user interface, a first input at the first tile associated with the currently played first media content item, within the visual array, to cause display of one of the additional tiles visible behind the first tile, at the user interface, wherein the first input is interpreted as indicative of a selection of the one of the additional tiles visible behind the first tile, and wherein the selected additional tile is associated with a second media content item from within the one or more additional media content items,

receiving, at the user interface, a second input indicative of a request to receive the selected second media content item for playback,

in response to receiving the second input, sending, to the computer server system, a third data message comprising instructions to return the selected second media content item,

receiving a fourth data message from the computer server system, the fourth data message comprising the selected second media content item, and

performing playback of the selected second media content item combined with the first media content item at the user interface, including

determining a first media type of the first media content item and a second media type of the selected second media content item, and

based on the determined first media type and the determined second media type, controlling playback of the first media content item and playback of the selected second media content item, including by continuing playback of the first media content item at one or more of a speaker or a display of the user interface, when performing playback of the selected second media content item.