SEGMENTED METADATA AND INDEXES FOR STREAMED MULTIMEDIA DATA

• US 20090055417A1
• Filed: 08/19/2008
• Published: 02/26/2009
• Est. Priority Date: 08/20/2007
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Hannuksela, Miska M.
• Granted Patent: US 9,852,219 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/908 using metadata automatically derived from the content
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format

Abstract

A method of organizing streamed data includes storing streamed data in a file, identifying metadata applicable to a subset of the streamed data, and forming at least one group of one or more samples of the streamed data, each sample in a group having identical metadata content for a metadata type. The file may be in accordance with ISO base media file format. The storing streamed data in a file may include storing in a reception hint track. The at least one group may be indicated in a sample group description box. The metadata type may be indicated by a grouping type and grouping instance data, the grouping type specifying semantics of the grouping instance data and the metadata content. The metadata content may comprise a metadata payload and zero or more metadata payload extensions, where the metadata payload is included in a first structure and the zero or more metadata payload extensions are included in a second structure.

Claims

1. A method of organizing streamed data, comprising:

storing streamed data in a file;

identifying metadata applicable to a subset of the streamed data; and

forming at least one group of one or more samples of the streamed data, each sample in a group having identical metadata content for a metadata type.

2. The method of claim 1, wherein the at least one group is identified in a file.

3. The method of claim 1, wherein the file is in accordance with ISO base media file format.

4. The method of claim 3, wherein the storing streamed data in a file includes storing in a reception hint track.

5. The method of claim 3, wherein the metadata type is indicated by a grouping type and grouping instance data, the grouping type specifying semantics of the grouping instance data and the metadata content.

6. The method of claim 5, wherein the metadata content comprises a metadata payload and zero or more metadata payload extensions, wherein the metadata payload is included in a first structure, and wherein the zero or more metadata payload extensions are included in a second structure.

7. The method of claim 5, wherein the at least one group is indicated in a sample group description box.

8. The method of claim 3, wherein the at least one group is indicated in a sample group description box.

9. The method of claim 1, wherein the metadata type includes titles of segments of the streamed data.

10. The method of claim 1, wherein a group includes samples from two or more tracks.

11. The method of claim 10, further comprising:

identifying the group including samples from two or more tracks with metadata associated with all related tracks.

12. The method of claim 10, further comprising:

identifying the group including samples from two or more tracks with metadata associated with a master track.

35. The method of claim 1, further comprising creating a timed metadata track for the streamed data.

36. The method of claim 35, wherein the file is in accordance with ISO base media file format.

37. The method of claim 36, wherein the storing streamed data in a file includes storing in a reception hint track.

38. The method of claim 36, wherein the at least one group is indicated in a sample group description box.

39. The method of claim 38, wherein the at least one group of one or more samples of the streamed data is indicated in a sample group description box for the timed metadata track through associating the at least one group of one or more samples of the streamed data with respective timed metadata samples in the timed metadata track.

40. The method of claim 35, wherein timed metadata track associates timing metadata with one or more timelines.

41. The method of claim 40, wherein timed metadata track associates timing metadata with two or more timelines.

13. A computer program embodied on a computer-readable medium, the computer program configured to provide a method comprising:

storing streamed data in a file;

identifying metadata applicable to a subset of the streamed data; and

forming at least one group of one or more samples of the streamed data, each sample in a group having identical metadata content for a metadata type.

14. The computer program of claim 13, wherein the at least one group is identified in a file.

15. The computer program of claim 13, wherein the file is in accordance with ISO base media file format.

16. The computer program of claim 15, wherein the storing streamed data in a file includes storing in a reception hint track.

17. The computer program of claim 15, wherein the metadata type is indicated by a grouping type and grouping instance data, the grouping type specifying semantics of the grouping instance data and the metadata content.

18. The computer program of claim 16, wherein the metadata content comprises a metadata payload and zero or more metadata payload extensions, wherein the metadata payload is included in a first structure, and wherein the zero or more metadata payload extensions are included in a second structure.

19. The computer program of claim 15, wherein the at least one group is indicated in a sample group description box.

20. The computer program of claim 13, wherein the metadata type includes titles of segments of the streamed data.

21. The computer program of claim 13, wherein a group includes samples from two or more tracks.

22. The computer program of claim 21, the method further comprising:

identifying the group including samples from two or more tracks with metadata associated with all related tracks.

23. The computer program of claim 21, the method further comprising:

identifying the group including samples from two or more tracks with metadata associated with a master track.

42. The computer program of claim 13, wherein the method further comprises:

creating a timed metadata track for the streamed data.

43. The computer program of claim 42, wherein the file is in accordance with ISO base media file format.

44. The computer program of claim 43, wherein the storing streamed data in a file includes storing in a reception hint track.

45. The computer program of claim 43, wherein the at least one group is indicated in a sample group description box.

46. The computer program of claim 45, wherein the at least one group of one or more samples of the streamed data is indicated in a sample group description box for the timed metadata track through associating the at least one group of one or more samples of the streamed data with respective timed metadata samples in the timed metadata track.

47. The computer program of claim 42, wherein timed metadata track associates timing metadata with one or more timelines.

48. The computer program of claim 47, wherein timed metadata track associates timing metadata with two or more timelines.

24. A receiver adapted to receive streamed data, comprising:

a storage unit for storing streamed data in a file; and

a processor adapted to;

identify metadata applicable to a subset of the streamed data; and

form at least one group of one or more samples of the streamed data, each sample in a group having identical metadata content for a metadata type.

25. The receiver of claim 24, wherein the processor is further adapted to identify the at least one group in a file stored in the storage unit.

26. The receiver of claim 24, wherein the file is in accordance with ISO base media file format.

27. The receiver of claim 26, wherein the storage unit is adapted to store the streamed data in a reception hint track.

28. The receiver of claim 26, wherein the metadata type is indicated by a grouping type and grouping instance data, the grouping type specifying semantics of the grouping instance data and the metadata content.

29. The receiver of claim 28, wherein the metadata content comprises a metadata payload and zero or more metadata payload extensions, wherein the metadata payload is included in a first structure, and wherein the zero or more metadata payload extensions are included in a second structure.

30. The receiver of claim 26, wherein the at least one group is indicated in a sample group description box.

31. The receiver of claim 24, wherein the metadata type includes titles of segments of the streamed data.

32. The receiver of claim 24, wherein a group includes samples from two or more tracks.

33. The receiver of claim 34, wherein the processor is further adapted to identify the group including samples from two or more tracks with metadata associated with all related tracks.

34. The receiver of claim 32, wherein the processor is further adapted to identify the group including samples from two or more tracks with metadata associated with a master track.

49. The receiver of claim 24, wherein the processor is further adapted to create a timed metadata track for the streamed data.

50. The receiver of claim 49, wherein the file is in accordance with ISO base media file format.

51. The receiver of claim 50, wherein the storage unit is adapted to store the streamed data in a reception hint track.

52. The receiver of claim 50, wherein the at least one group is indicated in a sample group description box.

53. The receiver of claim 52, wherein the at least one group of one or more samples of the streamed data is indicated in a sample group description box for the timed metadata track through associating the at least one group of one or more samples of the streamed data with respective timed metadata samples in the timed metadata track.

54. The receiver of claim 49, wherein timed metadata track associates timing metadata with one or more timelines.

55. The receiver of claim 54, wherein timed metadata track associates timing metadata with two or more timelines.

56. An apparatus, comprising:

means for identifying metadata applicable to a subset of the streamed data; and

means for forming at least one group of one or more samples of the streamed data, each sample in a group having identical metadata content for a metadata type.

57. The apparatus of claim 56, wherein the file is in accordance with ISO base media file format.

58. The apparatus of claim 57 wherein the storing streamed data in a file includes storing in a reception hint track.

59. The apparatus of claim 57, wherein the metadata type is indicated by a grouping type and grouping instance data, the grouping type specifying semantics of the grouping instance data and the metadata content.

60. The apparatus of claim 59, wherein the metadata content comprises a metadata payload and zero or more metadata payload extensions, wherein the metadata payload is included in a first structure, and wherein the zero or more metadata payload extensions are included in a second structure.

61. The apparatus of claim 57, wherein the at least one group is indicated in a sample group description box.