Method of recording three-dimensional image data

• US 8,922,621 B2
• Filed: 10/20/2008
• Issued: 12/30/2014
• Est. Priority Date: 10/19/2007
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd., University-Industry Cooperation Group of KyungHee University
• Original Assignee: Samsung Electronics Co. Ltd., University-Industry Cooperation Group of KyungHee University
• Inventors: Joung, Do-Young, Park, Tae-Sung, Oh, Yun-Je, Song, Jae-Yeon, Hwang, Seo-Young, Suh, Doug-Young, Park, Gwang-Hoon, Kim, Kyu-Heon, Lee, Yoon-Jin, Lee, Jang-Won
• Primary Examiner(s): Gilles, Jude Jean
• Assistant Examiner(s): Means, Jaren M
• Application Number:
  US12/254,175
• Publication Number:
  US 20090122134A1
• Time in Patent Office: 2,262 Days
• Field of Search: 348/42
• US Class Current: 348/42
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8063 using time division multiplex of the PCM audio and PCM video signals
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

A method of storing 3D image data in a recording medium includes: loading, in a predetermined file type field, image type information indicating either one of a single stereoscopic image or a compound image including a monoscopic image and a stereoscopic image; loading, in a predetermined image configuration information container field, scene descriptor information indicating temporal and spatial relations between a plurality of media objects included in the three-dimensional image, object configuration information indicating attributes of each media object of said plurality of media objects and a configuration relation between encoded streams of the plurality of media objects, configuration information of the encoded streams; loading in an image data container field media data of an image to be stored; and loading, in a meta container field, metadata including information for playing the 3D image data.

Claims

1. A method of storing three-dimensional (3D) image data in a recording medium, the method comprising:

loading, by a processor, in a predetermined field representing a file type, an image type indicator selected from the group consisting of a stereoscopic content indicator and a stereo-monoscopic mixed content indicator, wherein the stereoscopic content indicator represents that a plurality of images consists entirely of stereoscopic images, and the stereo-monoscopic mixed content indicator represents that the plurality of images includes mixed content comprising both a monoscopic image and a stereoscopic image;

loading, in a predetermined image configuration information container field, scene descriptor information indicating temporal and spatial relations between a plurality of media objects included in the 3D image data, object configuration information indicating attributes of each media object of said plurality of media objects, and configurative information indicating a configurative relation between encoded streams of the plurality of media objects;

loading, in an image data container field, media data of an image to be stored; and

loading, in a meta container field, metadata including information for playing the 3D image data.

2. The method as claimed in claim 1, wherein the meta container field is included in the predetermined image configuration information container field.

3. The method as claimed in claim 1, wherein, the loading includes storing in the field representing a file type the stereo-monoscopic mixed content indicator.

4. The method as claimed in claim 1, wherein the metadata includes configuration information on the stereoscopic content and the stereo-monoscopic mixed content, on sizes of images included in the stereoscopic content and the stereo-monoscopic mixed content, photographing information, and display information, and is recorded in an snmi box of the meta container field.

5. The method as claimed in claim 4, wherein the metadata includes information on location of the monoscopic and stereoscopic images included in the stereo-monoscopic mixed content, on sizes of data of the monoscopic and stereoscopic images, and on image type identifications of the monoscopic and stereoscopic images,

the location information and data sizes are recorded in an iloc box of the meta container field,

the image type identifications are recorded in an iinf box of the meta container field.

6. The method as claimed in claim 4, wherein the photographing information comprises a distance between a plurality of cameras, focal lengths of multiple camera lenses with respect to a subject, a rotation angle about an object, a maximum vertical disparity, and maximum disparity and minimum disparity between images photographed through the multiple camera lenses.

7. The method as claimed in claim 4, wherein, when frame rates of respective media data are different from each other, the snmi box includes information indicating reference media data and information indicating media data to be compressed first according to a type of a composite image.

8. The method as claimed in claim 2, wherein the stereoscopic image comprises at least one fragment.

9. The method as claimed in claim 8, wherein, the stereoscopic image comprises multiple fragments, fragments containing identical image information are grouped together into fragment groups, and the fragments are recorded according to the fragment groups in the meta container field.

10. The method as claimed in claim 9, wherein the number of fragment groups containing different image information is calculated, and the image information indicated by the respective fragments are recorded in the meta container field, based on the calculated number of the fragment groups.

11. The method as claimed in claim 1, wherein the metadata includes information on configuration of the stereoscopic content and stereo-monoscopic mixed content, on sizes of images included in the stereoscopic content and stereo-monoscopic mixed content, photographing information, and display information and is recorded in an snmi box of the meta container field.

12. The method as claimed in claim 11, wherein the metadata includes information on monoscopic and stereoscopic images included in the stereo-monoscopic mixed content, on the size of data of the monoscopic and stereoscopic images, and image type identifications of the monoscopic and stereoscopic images,

location information and data sizes are recorded in an iloc box of the meta container field,

the image type identifications are recorded in an iinf box of the meta container field.

13. The method as claimed in claim 11, wherein the photographing information comprises a distance between a plurality of cameras, focal lengths of multiple camera lenses with respect to a subject, a rotation angle about an object, a maximum vertical disparity, and maximum disparity and minimum disparity between images photographed through the multiple camera lenses.

14. The method as claimed in claim 11, wherein, when frame rates of respective media data are different from each other, the snmi box includes information indicating reference media data and information indicating media data to be compressed first according to a type of a composite image.

15. The method as claimed in claim 1, wherein the stereoscopic image comprises at least one fragment.

16. The method as claimed in claim 15, wherein, the stereoscopic image comprises multiple fragments, fragments containing identical image information are grouped together into fragment groups and the fragments are recorded according to the fragment groups in the meta container field.

17. The method as claimed in claim 16, wherein the number of fragment groups containing different image information is calculated, and the image information indicated by the respective fragments are recorded in the meta container field, based on the calculated number of the fragment groups.

18. A method of storing, in a non-transitory recording medium, three-dimensional (3D) image data representing a 3D image, the method comprising:

storing, in the recording medium, the 3D image data in a single 3D image data object having a FTYP field, a MOOV field, a MDAT field, and a META field;

wherein the FTYP field stores only an image type indicator selected from the group consisting of a stereoscopic content indicator and a stereo-monoscopic mixed content indicator, wherein the stereoscopic content indicator represents that a plurality of images consists entirely of stereoscopic images, and the stereo-monoscopic mixed content indicator represents that the plurality of images includes mixed content comprising both a monoscopic image and a stereoscopic image;

wherein the MOOV field stores scene descriptor information indicating temporal and spatial relations between a plurality of media objects included in the 3D image, object configuration information indicating attributes of each media object of said plurality of media objects, and configurative information indicating a configurative relation between encoded streams of the plurality of media objects;

wherein the MDAT field stores media data of an image to be stored; and

wherein the META field stores metadata including information for playing the 3D image data.

19. The method as claimed in claim 18, the method further comprising:

loading the 3D image data from the recording medium by a data storage controller.

20. An apparatus for storing, in a recording medium, three-dimensional (3D) image data, the apparatus comprising:

a data storage controller, operatively connected to the recording medium, for storing the 3D image data by;

loading, in a predetermined field representing a file type, an indicator selected from the group consisting of a stereoscopic content indicator and a stereo-monoscopic mixed content indicator, wherein the stereoscopic content indicator represents that a plurality of images consists entirely of stereoscopic images, and the stereo-monoscopic mixed content indicator represents that the plurality of images includes a stereo-monoscopic mixed content comprising both a monoscopic image and a stereoscopic image;

loading, in a predetermined image configuration information container field, scene descriptor information indicating temporal and spatial relations between a plurality of media objects, object configuration information indicating attributes of each media object of said plurality of media objects, and configurative information indicating a configurative relation between encoded streams of the plurality of media objects;

loading, in an image data container field, media data of an image to be stored; and

loading, in a meta container field, metadata including information for playing the 3D image data.