System and method for playback of media content with audio touch menu functionality

• US 9,489,113 B2
• Filed: 10/09/2015
• Issued: 11/08/2016
• Est. Priority Date: 03/28/2014
• Status: Active Grant

• Current Assignee: Spotify AB (Spotify Technology SA)
• Original Assignee: Spotify AB (Spotify Technology SA)
• Inventors: Dziuk, Dariusz
• Primary Examiner(s): ABDUL-ALI, OMAR R
• Application Number:
  US14/879,774
• Publication Number:
  US 20160103589A1
• Time in Patent Office: 396 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10657 Cache memories for random data access, e.g. buffers wherein the data output is controlled by a priority parameter other than retention time
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612

Abstract

A system and method for playback of media content, for example music, video, or other media content. A media device having a media playback application and including a touch-sensitive user interface can be adapted to display a visual array of media options, for example as a grid or list of card elements. Each media option can be associated with one or more media content items that can be streamed to and/or played on the device. The system can determine a selected card element, or media options that are proximate to a selected point or region of the visual array, and play or crossfade media content as appropriate. In accordance with various embodiments, additional features can be provided that improve user interaction, for example the use of audible notifications, media caching, or touch menus.

Claims

1. A system for playback of media content, including the use of touch menus, comprising:

a media device, including a processor, which media device is adapted to play media content provided by a computer system operating as a media server;

a user interface, provided at the media device, which user interface is adapted to display a visual array of at least one of playlists or media options,

wherein each media option is associated with one or more media content items that can be provided by the media server and streamed to the media device, to be played at the media device, and

wherein each media content item that can be provided by the media server and streamed to the media device is associated with one or more samples;

a prebuffering logic that enables a portion of each media content item to be pre-buffered at the media device, so that, while media options are being prepared for display, their related media content is pre-buffered at the same time;

a playback logic, provided at the media device, which is adapted to play media content items associated with one or more media options that are proximate to a selected point or region within the visual array; and

a touch logic, provided at the media devices, which is adapted to

determine a selection of a playlist that is associated with a plurality of the media options, and

in response to the selection of a selected playlist, display contents of the selected playlist, including a visual array of the plurality of the media options associated with the selected playlist, for further selection and playback.

2. The system of claim 1, wherein playlists can be one of stored locally on the media device, or stored at a server.

3. The system of claim 1, wherein upon selection of the selected playlist, a media option associated with the selected playlist is played, and is displayed together with others of the media options associated with the playlist, as part of the visual array.

4. The system of claim 1, wherein the user interface is adapted to enable the selected point or region to be moved between a first and second playlist, whereupon the user interface is updated to display contents of the selected playlist including a visual array of media options associated therewith.

5. The system of claim 1, wherein the system includes support for force-sensitive touch input in selection, playback, or other interaction with media options.

6. The system of claim 1, wherein, in response to receiving an input from the user interface, the playback logic determines a set of one or more media options that are proximate to the selected point or region, and adjusts playback volume of a set of media content items associated with the set of media options, by crossfading or otherwise combining playback of the set of media content items, to reflect relative distances of the set of media options from the selected point or region.

7. The system of claim 1,

wherein, in response to a selection of a particular playlist option, the system displays the visual array of media options associated with the particular playlist option, wherein each media option is associated with one or more media content items that can be selected for playing;

and

wherein, in response to selection of a new playlist option, the system displays a visual array of media options associated with the new playlist option.

8. A method for playback of media content, including the use of touch menus, comprising:

displaying, at a media device having a user interface, which media device is adapted to play media content provided by a computer system operating as a media server, a visual array of at least one of playlists or media options,

wherein each media option is associated with one or more media content items that can be provided by the media server and streamed to the media device, to be played at the media device, and

wherein each media content item that can be provided by the media server and streamed to the media device is associated with one or more samples;

pre-buffering a portion of each media content item at the media device, so that, while media options are being prepared for display, their related media content is pre-buffered at the same time;

determining, while a selected point or region is moved within the visual array in response to user input, a selection of a playlist that is associated with a plurality of the media options; and

in response to the selection of a selected playlist, displaying contents of the selected playlist, as a visual array of the plurality of the media options associated with the selected playlist, for further selection and playback.

9. The method of claim 8, wherein playlists can be one of stored locally on the media device, or stored at a server.

10. The method of claim 8, wherein upon selection of the selected playlist, a media option associated with the selected playlist is played, and is displayed together with others of the media options associated with the playlist, as part of the visual array.

11. The method of claim 8, wherein the user interface is adapted to enable the selected point or region to be moved between a first and second playlist, whereupon the user interface is updated to display contents of the selected playlist including a visual array of media options associated therewith.

12. The method of claim 8, further including providing support for force-sensitive touch input in selection, playback, or other interaction with media options.

13. The method of claim 8, including that instructions for performing the method are stored in a non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a device having one or more processors, cause the device to perform the method.

14. The method of claim 8, wherein, in response to receiving an input from the user interface, the method comprises determining a set of one or more media options that are proximate to the selected point or region, and adjusting playback volume of a set of media content items associated with the set of media options, by crossfading or otherwise combining playback of the set of media content items, to reflect relative distances of the set of media options from the selected point or region.

15. The method of claim 8,

wherein, in response to a selection of a particular playlist option, a visual array of media options associated with the particular playlist option is displayed, wherein each media option is associated with one or more media content items that can be selected for playing;

and

wherein, in response to selection of a new playlist option, a visual array of media options associated with the new playlist option is displayed.

16. A device for playback of media content, including the use of touch menus, comprising:

a media device, including a processor, which media device is adapted to play media content provided by a computer system operating as a media server;

a user interface, provided at the media device, which user interface is adapted to display a visual array of at least one of playlists or media options,

wherein each media option is associated with one or more media content items that can be provided by the media server and streamed to the media device, to be played at the media device, and

wherein each media content item that can be provided by the media server and streamed to the media device is associated with one or more samples;

wherein the media device enables a portion of each media content item to be pre-buffered at the media device, so that, while media options are being prepared for display, their related media content is pre-buffered at the same time; and

wherein input is received from a user, at the user interface, including a selection of a card element, point or region within the visual array, corresponding to a selected media option,

wherein the selection of card element, point or region within the visual array, corresponding to a selected media option, is communicated to the media server, for use by the media server in determining one or more media options associated with or proximate to the selected card element, point or region, for use in adjusting playback of those media options,

wherein streamed media content associated with the one or more media options associated with or proximate to the selected card element, is received from the media server, and

wherein, in response to the selection of the selected media option, a visual array of additional media options associated with the selected media option is displayed, wherein each media option in the visual array of additional media options is similarly associated with one or more media content items that can be selected for playing.

17. The device of claim 16, wherein the device includes support for force-sensitive touch input in selection, playback, or other interaction with media options.

18. The device of claim 16, wherein, in response to receiving an input from the user interface, the media device determines a set of one or more media options that are proximate to the selected point or region, and adjusts playback volume of a set of media content items associated with the set of media options, by crossfading or otherwise combining playback of the set of media content items, to reflect relative distances of the set of media options from the selected point or region.

19. The device of claim 16,

wherein, in response to a selection of a particular playlist option, the media device displays the visual array of media options associated with the particular playlist option, wherein each media option is associated with one or more media content items that can be selected for playing;

and

wherein, in response to selection of a new playlist option, the media device displays a visual array of media options associated with the new playlist option.

20. A server for use in playback of media content, including the use of touch menus, comprising:

a computer device, including a processor, and a media server executing thereon;

a repository of media content items, and samples associated therewith;

a media application interface configured to receive requests from media devices or other systems, to retrieve media content from the media server; and

wherein input is received from a client computer system or device having a media playback application and user interface which enables display of a visual array of media options, which client computer system or device is adapted to play media content provided by the media server,

wherein each media option is associated with one or more of the media content items that can be provided by the media server and streamed to the client computer system or device, to be played at the client computer system or device, and wherein each media content item that can be provided by the media server and streamed to the media device is associated with one or more samples;

wherein a portion of each media content item is pre-buffered at the media device, so that, while media options are being prepared for display, their related media content is pre-buffered at the same time

wherein the media server receives a selection of a card element, point or region within the visual array, corresponding to a selected media option,

wherein one or more media options associated with or proximate to the selected card element, point or region, are determined, for use in adjusting playback of those media options, and

wherein media content associated with the one or more media options associated with or proximate to the selected card element, is streamed to the client computer system or device, for use by the client computer system or device in displaying a visual array of additional media options associated with the selected media options.