System and method for efficiently providing media and associated metadata

• US 9,529,888 B2
• Filed: 12/19/2013
• Issued: 12/27/2016
• Est. Priority Date: 09/23/2013
• Status: Active Grant

• Current Assignee: Spotify AB (Spotify Technology SA)
• Original Assignee: Spotify AB (Spotify Technology SA)
• Inventors: Oman, Andreas, Hoffert, Eric, Strigeus, Ludvig
• Primary Examiner(s): Hu, Jensen
• Application Number:
  US14/134,950
• Publication Number:
  US 20150088890A1
• Time in Patent Office: 1,104 Days
• Field of Search: 707/737
• US Class Current: 1/1
• CPC Class Codes: G06F 16/1744 using compression, e.g. sparse files
• CPC Class Codes: G06F 16/24553 of query operations
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures

Abstract

An electronic device with one or more processors, memory and a display obtains a file header for a file corresponding to a plurality of clusters, where the file header includes a cluster index. The device receives a request to seek to a respective position within the file and, in response to receiving the request: identifies a cluster of the plurality of clusters that includes content that corresponds to the respective position based on the cluster index; obtains a cluster header associated with the cluster based on information retrieved from the cluster index, where the cluster header includes a content index; and after obtaining the cluster header, identifies respective content within the cluster corresponding to the respective position based on the content index. The device provides at least a portion of content corresponding to the file to a presentation device for presentation to a user, starting with the respective content.

Claims

1. A method of seeking within media content, comprising:

at an electronic device with one or more processors and memory;

obtaining a file header for a file that corresponds to a plurality of clusters, wherein;

the file header includes a cluster index that enables coarse searching within the file,

the file header and the file omit respective omitted information that is necessary for extracting content from the file, and

the respective omitted information was removed from the file header and/or the file in accordance with a determination that the respective omitted information describes aspects of the content corresponding to the file that are already known to the electronic device;

receiving a request to seek to a respective position within the file;

in response to receiving the request;

identifying a cluster of the plurality of clusters that includes content that corresponds to the respective position based on the cluster index;

obtaining a cluster header associated with the cluster based on information retrieved from the cluster index, wherein the cluster header includes a content index that enables fine searching within the cluster;

obtaining cluster data associated with the cluster; and

after obtaining the cluster header, identifying respective content within the cluster that corresponds to the respective position based on the content index; and

after identifying the respective content, providing at least a portion of content corresponding to the file to a presentation device for presentation to a user, starting with the respective content.

2. The method of claim 1, wherein:

the file includes video data;

a respective cluster of the plurality of clusters corresponds to a group of frames with a respective keyframe; and

the respective content corresponds to one or more frames in the video data.

3. The method of claim 1, wherein:

the file includes audio data;

a respective cluster of the plurality of clusters corresponds to a group of audio samples or audio frames; and

the respective content corresponds to one or more audio samples or audio frames in the audio data.

4. The method of claim 1, wherein the file header is obtained in response to a request for content associated with the file.

5. The method of claim 1, wherein the file header further includes a global header that provides content description information that enables the device to prepare content of the file for presentation to the user.

6. The method of claim 1, wherein the cluster index does not include information that enables fine searching within the file.

7. The method of claim 1, wherein:

the respective omitted information was removed from the file header and/or the file before the file header was obtained by the electronic device; and

the method includes, prior to providing the portion of content corresponding to the file to the presentation device for presentation to the user;

generating the respective information based on the file header and/or the file; and

adding the omitted information into the file header and/or file.

8. The method of claim 1, wherein the respective omitted information was removed from the file header and/or the file in accordance with a determination that the respective omitted information is duplicative of information that was included elsewhere in the file header and/or the file.

9. The method of claim 1, wherein the file header is compressed, and the method includes, prior to using the cluster index, decompressing the file header and identifying the cluster index in the decompressed file header.

10. The method of claim 1, wherein:

the content index in the cluster header for the cluster includes a sequence of content entries including a first content entry that corresponds to first content followed by a second content entry that corresponds to second content followed by a third content entry that corresponds to third content;

the second content entry includes information that identifies a position of the second content based on a distance between corresponding portions of the first content and the second content; and

the third content entry includes information that identifies a position of the third content based on a distance between corresponding portions of the second content and the third content.

11. The method of claim 1, wherein:

the content index in the cluster header for the cluster includes a sequence of content entries including a first content entry that corresponds to first content followed by a second content entry that corresponds to second content followed by a third content entry that corresponds to third content; and

the third content entry includes information that identifies a position of the third content based on a difference between;

a distance between corresponding portions of the first content and the second content; and

a distance between corresponding portions of the second content and the third content.

12. The method of claim 10, wherein:

the content index for the cluster includes;

an overall size of the cluster;

a plurality of entries for corresponding content that include information from which sizes of corresponding content can be determined; and

a respective entry for respective content that does not include information from which a size of the respective content can be determined; and

the method includes determining a size of the respective content based on the overall size of the cluster and the sizes of the content corresponding to the plurality of entries in the cluster other than the respective entry.

13. The method of claim 1, wherein:

the file header is obtained from a first location; and

the content corresponding to the file is obtained from a second location distinct from the first location.

14. The method of claim 1, wherein:

the cluster header is obtained in a first location; and

the cluster data is obtained from one or more locations different from the first location.

15. The method of claim 1, wherein the plurality of clusters have a predefined size.

16. The method of claim 1, wherein:

a first cluster of the plurality of clusters has a first size; and

a second cluster of the plurality of clusters has a second size different from the first size.

17. A computer system, comprising:

one or more processors; and

memory;

storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

obtaining a file header for a file that corresponds to a plurality of clusters, wherein;

the file header includes a cluster index that enables coarse searching within the file,

the file header and the file omit respective omitted information that is necessary for extracting content from the file, and

the respective omitted information was removed from the file header and/or the file in accordance with a determination that the respective omitted information describes aspects of the content corresponding to the file that are already known to the electronic device;

receiving a request to seek to a respective position within the file;

in response to receiving the request;

identifying a cluster of the plurality of clusters that includes content that corresponds to the respective position based on the cluster index;

obtaining a cluster header associated with the cluster based on information retrieved from the cluster index, wherein the cluster header includes a content index that enables fine searching within the cluster;

obtaining cluster data associated with the cluster; and

after obtaining the cluster header, identifying respective content within the cluster that corresponds to the respective position based on the content index; and

after identifying the respective content, providing at least a portion of content corresponding to the file to a presentation device for presentation to a user, starting with the respective content.

18. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with one or more processors, cause the device to:

obtain a file header for a file that corresponds to a plurality of clusters, wherein;

the file header includes a cluster index that enables coarse searching within the file,

the file header and the file omit respective omitted information that is necessary for extracting content from the file, and

the respective omitted information was removed from the file header and/or the file in accordance with a determination that the respective omitted information describes aspects of the content corresponding to the file that are already known to the electronic device;

receive a request to seek to a respective position within the file;

in response to receiving the request;

identify a cluster of the plurality of clusters that includes content that corresponds to the respective position based on the cluster index;

obtain a cluster header associated with the cluster based on information retrieved from the cluster index, wherein the cluster header includes a content index that enables fine searching within the cluster;

obtain cluster data associated with the cluster; and

after obtaining the cluster header, identify respective content within the cluster that corresponds to the respective position based on the content index; and

after identifying the respective content, provide at least a portion of content corresponding to the file to a presentation device for presentation to a user, starting with the respective content.