Method, device, and computer program for encapsulating partitioned timed media data using sub-track feature

• US 10,212,491 B2
• Filed: 07/21/2014
• Issued: 02/19/2019
• Est. Priority Date: 07/23/2013
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Denoual, Franck, Maze, Frederic, Le Feuvre, Jean, Concolato, Cyril
• Primary Examiner(s): Flynn, Nathan J
• Assistant Examiner(s): Fogg, Cynthia M
• Application Number:
  US14/906,534
• Publication Number:
  US 20160165321A1
• Time in Patent Office: 1,674 Days
• Field of Search: 725116
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/4382 Demodulation or channel decoding, e.g. QPSK demodulation analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments
• CPC Class Codes: H04N 21/8451 using Advanced Video Coding [AVC]
• CPC Class Codes: H04N 21/854 Content authoring
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format

Abstract

The invention relates to encapsulating partitioned timed media data to be streamed to a client'"'"'s device, the partitioned timed media data comprising timed samples, each comprising a plurality of subsamples. After having grouped several of the subsamples to form at least one group so that at least part of the subsamples belongs to a group of subsamples, at least two subsamples of the same group are selected from amongst the plurality of subsamples of one of the timed samples and at least one track comprising the selected subsamples is created. Next, for the at least one created track, one sub-track box is created for each of the subsamples selected to create the at least one track, at least one of the created sub-track boxes comprising definitions and properties that are common to the selected sub-samples. Each of the created tracks is independently encapsulated in at least one media file.

Claims

1. A method of generating at least one media file based on partitioned timed media data in a server to be transmitted to a client, the partitioned timed media data comprising timed samples, each timed sample comprising a plurality of subsamples, the method comprises:

grouping one or more of the plurality of subsamples of a timed sample into at least one group;

creating at least one track comprising one or more subsamples which are grouped into a same group and corresponding subsamples of other timed samples,

and creating a box for describing a group identifier of the subsamples which are grouped into said same group, the group identifier being used to associate NAL units of the subsamples which are grouped into said same group with a particular TileRegionGroupEntry; and

generating at least one media file based on each of the created tracks and the created box.

2. The method of claim 1, further comprising a step of linking a group of samples or of subsamples to at least one tile.

3. The method of claim 2, wherein at least one of the created boxes or an associated track comprises information to indicate that the at least one of the created boxes or the associated track provides tiling information.

4. The method of claim 2, wherein the step of linking a group of samples or of subsamples to at least one tile comprises defining a sample group description identifier in one created box, the value of said sample group description identifier corresponding to a tile identifier value associated with the at least one tile.

5. The method of claim 1, wherein a group of tiles is encoded within at least one sub-track associated with at least one of the created boxes.

6. The method of claim 5, wherein at least one of the created boxes comprises information to indicate a number of tiles encoded within a sub-track associated with at least one of the created boxes.

7. The method of claim 1, wherein the group identifier is described in a movie box (moov box) defined in ISO/IEC 14496-12.

8. The method of claim 1, wherein said TileRegionGroupEntry comprising:

the group identifier,

information relating to coding dependencies of corresponding subsamples, and

information relating to horizontal offset and vertical offset of corresponding subsamples.

9. A non-transitory computer-readable storage medium storing instructions of a computer program for causing a computer to implement the method according to claim 1.

10. The method of claim 1, wherein the created box corresponds to a TileRegionGroupEntry.

11. A device for generating at least one media file based on partitioned timed media data to be transmitted to another device, the partitioned timed media data comprising timed samples, each timed sample comprising a plurality of subsamples, the device comprising at least one processor configured to:

group one or more of the plurality of subsamples of a timed sample into at least one group;

create at least one track comprising one or more subsamples which are grouped into a same group and corresponding subsamples of other timed samples, and create a box for describing a group identifier of the subsamples which are grouped into said same group, the group identifier being used to associated NAL units of the subsamples which are grouped into said same group with a particular TileRegionGroupEntry; and

generate at least one media file based on each of the created tracks and the created box.

12. The device of claim 11, wherein the group identifier is described in a movie box (moov box) defined in ISO/IEC 14496-12.

13. The device of claim 11, wherein said TileRegionGroupEntry comprises:

the group identifier,

information relating to coding dependencies of corresponding subsamples, and

information relating to horizontal offset and vertical offset of corresponding subsamples.

14. The device of claim 11, wherein at least one of the created boxes comprises information to indicate that the at least one of the created boxes provides tiling information.

15. The device of claim 11, wherein the at least one processor is further configured to link a group of samples or of subsamples to at least one tile.

16. The device of claim 15, wherein linking a group of samples or of subsamples to at least one tile comprises defining a sample group description identifier in one created box, the value of said sample group description identifier corresponding to a tile identifier value associated with the at least one tile.

17. The device of claim 11, wherein a group of tiles is encoded within at least one sub-track associated with at least one of the created boxes.

18. The device of claim 11, wherein at least one of the created boxes comprises information to indicate a number of tiles encoded within a sub-track associated with at least one of the created boxes.

19. The device of claim 11, wherein media files generated based on each of the created tracks comprise a data structure for storing metadata including definitions of the corresponding track, including definitions of the created boxes comprised within the corresponding track.

20. The device of claim 11, wherein the created box corresponds to a TileRegionGroupEntry.