File generation apparatus, file generating method, file reproduction apparatus, and file reproducing method

• US 9,918,099 B2
• Filed: 07/10/2014
• Issued: 03/13/2018
• Est. Priority Date: 07/19/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Takahashi, Ryohei, Uchimura, Kouichi, Hattori, Shinobu
• Primary Examiner(s): SENFI, BEHROOZ M
• Application Number:
  US14/416,396
• Publication Number:
  US 20150208078A1
• Time in Patent Office: 1,342 Days
• CPC Class Codes: G11B 20/10 Digital recording or reproducing
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/4854 for modifying image parameters, e.g. image brightness, contrast
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 7/0117 involving conversion of the spatial resolution of the incoming video signal for graphics images G09G2340/0407
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

The present technique relates to a file generation apparatus, a file generating method, a file reproduction apparatus, and a file reproducing method capable of enabling a user to enjoy an HDR image.

HDR information designated by HDR designating information is acquired from a file storing a track of a stream including the HDR information which is configured with feature information representing features of luminance of an HDR (high dynamic range) image having a dynamic range higher than that of an STD (standard) image and conversion information representing a conversion rule of converting the one of the STD image and the HDR image into the other and a target track including the HDR designating information designating the HDR information which is to be applied to the target track of interest in the HDR information of the track. The present technique can be applied, for example, to the case of storing data of images of a subtitle or the like and HDR information which is to be applied to the images in an MP4 file or the like.

Claims

1. A file generation apparatus comprising at least one processor programmed to:

receive at least one high dynamic range (HDR) image, the at least one HDR image having a dynamic range higher than that of a standard (STD) image; and

generate a file based on the at least one HDR image, the file comprising;

a target track including a plurality of sets of HDR information, wherein the plurality of sets of HDR information comprise a first set of HDR information comprising feature information representing features of luminance of the at least one HDR image, and a second set of HDR information comprising conversion information representing a conversion rule of converting one of the STD image and the at least one HDR image into the other; and

HDR designating information designating one or more sets of the plurality of sets of HDR information to be applied to the target track.

2. The file generation apparatus according to claim 1, wherein the file is a file having a box structure.

3. The file generation apparatus according to claim 2, wherein the file is an MP4file regulated in ISO/IEC 14496-14.

4. The file generation apparatus according to claim 3, wherein the target track includes a tinf box (ToneMappingInformationBox), and at least one set of the plurality of sets of HDR information is stored in the tinf box.

5. The file generation apparatus according to claim 4, wherein the target track includes a tirf box (ToneMappingInformationReferecenceBox), and the HDR designating information is stored in the tirf box.

6. The file generation apparatus according to claim 3, wherein the plurality of sets of HDR information comprise a set of HDR information which is to be commonly applied to a plurality of components of the at least one HDR image, a set of HDR information which is to be applied to one component among the plurality of components of the at least one HDR image, or a set of HDR information which is to be applied to each of the plurality of components of the at least one HDR image.

7. A file generating method performed by at least one processor, the method comprising acts of:

receiving at least one high dynamic range (HDR) image, the at least one HDR image having a dynamic range higher than that of a standard (STD) image; and

generating a file based on the at least one HDR image, the file comprising;

a target track including a plurality of sets of HDR information, wherein the plurality of sets of HDR information comprise a first set of HDR information comprising feature information representing features of luminance of the at least one HDR image, and a second set of HDR information comprising conversion information representing a conversion rule of converting one of the STD image and the at least one HDR image into the other; and

HDR designating information designating one or more sets of the plurality of sets of HDR information to be applied to the target track.

8. A file reproduction apparatus comprising at least one processor programmed to:

receive a file, the file comprising;

a target track including a plurality of sets of high dynamic range (HDR) information, wherein the plurality of sets of HDR information comprise a first set of HDR information comprising feature information representing features of luminance of an HDR image having a dynamic range higher than that of a standard (STD) image, and a second set of HDR information comprising conversion information representing a conversion rule of converting one of the STD image and the HDR image into the other; and

HDR designating information designating one or more sets of the plurality of sets of HDR information to be applied to the target track;

acquire the HDR designating information from the file;

use the HDR designating information acquired from the file to acquire the one or more sets of the plurality of sets of HDR information from the target track; and

apply the one or more sets of the plurality of sets of HDR information to the target track.

9. The file reproduction apparatus according to claim 8, wherein the file is a file having a box structure.

10. The file reproduction apparatus according to claim 9, wherein the file is an MP4file regulated in ISO/IEC 14496-14.

11. The file reproduction apparatus according to claim 10,

wherein the target track includes a tinf box (ToneMappingInformationBox), and at least one set of the plurality of sets of HDR information is stored in the tinf box, and

wherein the at least one processor is programmed to acquire the at least one set of HDR information stored in the tinf box.

12. The file reproduction apparatus according to claim 11,

wherein the target track includes a tirf box (ToneMappingInformationReferecenceBox), and the HDR designating information is stored in the tirf box, and

wherein the at least one processor is programmed to acquire the HDR designating information stored in the tirf box.

13. The file reproduction apparatus according to claim 10, wherein the plurality of sets of HDR information comprise a set of HDR information which is to be commonly applied to a plurality of components of the at least one HDR image, a set of HDR information which is to be applied to one component among the plurality of components of the at least one HDR image, or a set of HDR information which is to be applied to each of the plurality of components of the at least one HDR image.

14. A file reproducing method performed by at least one processor, the method comprising acts of:

receiving a file, the file comprising;

a target track including a plurality of sets of high dynamic range (HDR) information, wherein the plurality of sets of HDR information comprise a first set of HDR information comprising feature information representing features of luminance of an HDR image having a dynamic range higher than that of a standard (STD) image, and a second set of HDR information comprising conversion information representing a conversion rule of converting one of the STD image and the HDR image into the other; and

HDR designating information designating one or more sets of the plurality of sets of HDR information to be applied to the target track;

acquiring the HDR designating information from the file;

using the HDR designating information acquired from the file to acquire the one or more sets of the plurality of sets of HDR information from the target track; and

applying the one or more sets of the plurality of sets of HDR information to the target track.

15. A file generation apparatus comprising at least one processor programmed to:

receive at least one high dynamic range (HDR) image, the at least one HDR image having a dynamic range higher than that of a standard (STD) image; and

generate a file based on the at least one HDR image, the file comprising;

an HDR information track comprising a plurality of sets of HDR information, wherein the plurality of sets of HDR information comprise a first set of HDR information comprising feature information representing features of luminance of the at least one HDR image, and a second set of HDR information comprising conversion information representing a conversion rule of converting one of the STD image and the at least one HDR image into the other; and

a target track including;

track designating information designating the HDR information track; and

HDR designating information designating one or more sets of the plurality of sets of HDR information to be applied to the target track.

16. The file generation apparatus according to claim 15, wherein the file is a file having a box structure.

17. The file generation apparatus according to claim 16, wherein the file is an MP4file regulated in ISO/IEC 14496-14.

18. The file generation apparatus according to claim 17, wherein the target track includes a tirf box (ToneMappingInformationReferecenceBox), and the HDR designating information is stored in the tirf box.

19. The file generation apparatus according to claim 18, wherein the target track includes a TrackReferenceTypeBox where tmpi which is defined as reference_type of the TrackReferenceTypeBox and which represents that the TrackReferenceTypeBox included in a TrackReferenceBox is to be used for storing the track designating information becomes the reference_type.

20. The file generation apparatus according to claim 17, wherein the plurality of sets of HDR information comprise a set of HDR information which is to be commonly applied to a plurality of components of the at least one HDR image, a set of HDR information which is to be applied to one component among the plurality of components of the at least one HDR image, or a set of HDR information which is to be applied to each of the plurality of components of the at least one HDR image.

21. A file generating method performed by at least one processor, the method comprising acts of:

receiving at least one high dynamic range (HDR) image, the at least one HDR image having a dynamic range higher than that of a standard (STD) image; and

generating a file based on the at least one HDR image, the file comprising;

an HDR information track comprising a plurality of sets of HDR information, wherein the plurality of sets of HDR information comprise a first set of HDR information comprising feature information representing features of luminance of the at least one HDR image, and a second set of HDR information comprising conversion information representing a conversion rule of converting one of the STD image and the at least one HDR image into the other; and

a target track including;

track designating information designating the HDR information track; and

HDR designating information designating one or more sets of the plurality of sets of HDR information to be applied to the target track.

22. A file reproduction apparatus comprising at least one processor programmed to:

receive a file, the file comprising;

a high dynamic range (HDR) information track comprising a plurality of sets of HDR information, wherein the plurality of sets of HDR information comprise a first set of HDR information comprising feature information representing features of luminance of an HDR image having a dynamic range higher than that of a standard (STD) image, and a second set of HDR information comprising conversion information representing a conversion rule of converting one of the STD image and the HDR image into the other; and

a target track including;

track designating information designating the HDR information track; and

HDR designating information designating one or more sets of the plurality of sets of HDR information to be applied to the target track;

acquire the track designating information and the HDR designating information from the file;

use the track designating information and the HDR designating information acquired from the file to acquire the one or more sets of the plurality of sets of HDR information from the HDR information track; and

apply the one or more sets of the plurality of sets of HDR information to the target track.

23. The file reproduction apparatus according to claim 22, wherein the file is a file having a box structure.

24. The file reproduction apparatus according to claim 23, wherein the file is an MP4file regulated in ISO/IEC 14496-14.

25. The file reproduction apparatus according to claim 24,

wherein the target track includes a tirf box (ToneMappingInformationReferecenceBox), and the HDR designating information is stored in the tirf box, and

wherein the at least one processor is programmed to acquire the HDR designating information stored in the tirf box included in the target track.

26. The file reproduction apparatus according to claim 25,

wherein the target track includes a TrackReferenceTypeBox where tmpi which is defined as reference_type of the TrackReferenceTypeBox and which represents that the TrackReferenceTypeBox included in a TrackReferenceBox is to be used for storing the track designating information becomes the reference_type, and

wherein the acquisition unit acquires the HDR information designated by the HDR designating information from the HDR information of the HDR information track designated by the track designating information stored in the TrackReferenceTypeBox where the reference_type becomes the tmpi.

27. The file reproduction apparatus according to claim 24, wherein the plurality of sets of HDR information comprise a set of HDR information which is to be commonly applied to a plurality of components of the at least one HDR image, a set of HDR information which is to be applied to one component among the plurality of components of the at least one HDR image, or a set of HDR information which is to be applied to each of the plurality of components of the at least one HDR image.

28. A file reproducing method performed by at least one processor, the method comprising acts of:

receiving a file, the file comprising;

a high dynamic range (HDR) information track comprising a plurality of sets of HDR information, wherein the plurality of sets of HDR information comprise a first set of HDR information comprising feature information representing features of luminance of an HDR image having a dynamic range higher than that of a standard (STD) image, and a second set of HDR information comprising conversion information representing a conversion rule of converting one of the STD image and the HDR image into the other; and

a target track including;

track designating information designating the HDR information track; and

HDR designating information designating one or more sets of the plurality of sets of HDR information to be applied to the target track;

acquiring the track designating information and the HDR designating information from the file;

using the track designating information and the HDR designating information acquired from the file to acquire the one or more sets of the plurality of sets of HDR information from the HDR information track; and

applying the one or more sets of the plurality of sets of HDR information to the target track.