METHOD AND APPARATUS FOR PROVIDING A MULTI-VIEW STILL IMAGE SERVICE, AND METHOD AND APPARATUS FOR RECEIVING A MULTI-VIEW STILL IMAGE SERVICE

• US 20120314937A1
• Filed: 02/23/2011
• Published: 12/13/2012
• Est. Priority Date: 02/23/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Yong-Tae, Park, Ha-Joong, Min, Houng-Sog, Hong, Sung-Bin, Choi, Kwang-Cheol, Lee, Gun-IlI
• Granted Patent: US 9,456,196 B2
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: H04N 13/144 for flicker reduction
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/194 Transmission of image signals

Abstract

Provided are an apparatus and a method of providing a multiview still image service. The method includes: configuring a multiview still image file format including a plurality of image areas into which a plurality of pieces of image information forming a multiview still image are inserted; inserting the plurality of pieces of image information into the plurality of image areas, respectively; inserting three-dimensional (3D) basic attribute information to three-dimensionally reproduce the multiview still image into a first image area of the plurality of image areas into which main-view image information from among the plurality of pieces of image information is inserted; and outputting multiview still image data comprising the plurality of pieces of image information based on the multiview still image file format.

Claims

1. A method of providing a multiview still image service, the method comprising:

configuring a multiview still image file format comprising a plurality of image areas;

inserting a plurality of pieces of image information corresponding to a multiview still image into the plurality of image areas, respectively;

inserting three-dimensional (3D) basic attribute information to three-dimensionally reproduce the multiview still image into a first image area of the plurality of image areas; and

outputting multiview still image data comprising the plurality of pieces of image information based on the multiview still image file format

wherein main-view image information from among the plurality of pieces of image information is inserted into the first image area.

14. A computer-readable recording medium having recorded thereon a program for executing the method of claim 1, by using a computer.

16. The method of claim 1, further comprising:

inserting area offset information into an additional information area of the first image area into which the 3D basic attribute information is inserted,

wherein the area offset information indicates a start position of each of the plurality of image areas, and

wherein the area offset information is information for extracting remaining pieces of image information, other than the main-view image information, from remaining image areas, other than the first image area.

17. The method of claim 1, wherein the inserting the 3D basic attribute information comprises inserting the 3D basic attribute information into a supplementary additional information area of the first image area, distinct from a first additional information area into which Exchangeable Image File Format (EXIF) information is inserted.

18. The method of claim 1, wherein the inserting the 3D basic attribute information comprises inserting the 3D basic attribute information into a first additional information area of the plurality of image areas.

19. The method of claim 1, further comprising inserting 3D additional attribute information about current image information, from among the plurality of pieces of image information, into a supplementary additional information area of each of the plurality of image areas, distinct from an additional information area into which the 3D basic attribute information is inserted.

20. The method of claim 1, wherein the 3D basic attribute information comprises information about a horizontal value and a vertical value of an aspect ratio of an original image of a predetermined view image from among the multiple view images that form the multiview still image.

21. The method of claim 1, wherein, when one or more stereo pairs formed by the plurality of pieces of image information comprise a stereo pair having depth information between different views, the 3D basic attribute information comprises multipath information indicating the stereo pair having depth information between views that correspond to sizes of reproducing apparatuses.

2. A method of receiving a multiview still image service, the method comprising:

receiving and parsing multiview still image data based on a multiview still image file format comprising a plurality of image areas;

extracting 3D basic attribute information to three-dimensionally reproduce a multiview still image from a first image area of the plurality of image areas; and

extracting main-view image information, from among a plurality of pieces of image information forming the multiview still image, from the first image area, and extracting remaining pieces of image information of the plurality of pieces of image information from remaining image areas of the plurality of image areas, respectively,

wherein the main-view image information is inserted into the first image area.

3. The method of claim 2, further comprising restoring and three-dimensionally reproducing multiple view images that form the multiview still image, by using the extracted 3D basic attribute information and the plurality of pieces of extracted image information.

4. The method of claim 2, further comprising:

extracting area offset information from an additional information area of the first image area into which the 3D basic attribute information is inserted,

wherein the area offset information indicates a start position of each of the plurality of image areas, and

wherein the extracting the remaining pieces of image information comprises extracting the remaining pieces of image information from the remaining image areas which are determined based on the area offset information.

5. The method of claim 2, wherein the extracting the 3D basic attribute information comprises extracting the 3D basic attribute information from a supplementary additional information area of the first image area, distinct from a first additional information area into which Exchangeable Image File Format (EXIF) information is inserted.

6. The method of claim 2, wherein the extracting the 3D basic attribute information comprises extracting the 3D basic attribute information from a first additional information area of the plurality of image areas.

7. The method of claim 2, further comprising extracting 3D additional attribute information about current image information, from among the plurality of pieces of image information, from a supplementary additional information area of each of the plurality of image areas, distinct from an additional information area into which the 3D basic attribute information is inserted.

8. The method of claim 2, wherein the 3D basic attribute information comprises information about a horizontal value and a vertical value of an aspect ratio of an original image of a predetermined view image from among the multiple view images that form the multiview still image.

9. The method of claim 2, wherein, when one or more stereo pairs formed by the plurality of pieces of image information comprise a stereo pair having depth information between different views, the 3D basic attribute information comprises multipath information indicating the stereo pair having depth information between views that correspond to sizes of reproducing apparatuses.

10. The method of claim 7, wherein the 3D additional attribute information comprises information about a size of an occlusion area that occurs at a boundary of a current view image of the current image information in comparison to a reference view image, and information about a direction of the boundary at which the occlusion area occurs.

11. The method of claim 7, wherein the 3D additional attribute information comprises at least one of:

information about a number of pieces of image information which form a stereo pair with a current view image of the current image information from among the plurality of pieces of image information, information about a view index of at least one paired view image forming the stereo pair, information about a width and a height of a reproduction image of the current view image which is used to adjust a binocular parallax between the current view image and a paired view image which form the stereo pair, information about horizontal and vertical coordinates of the reproduction image of the current view image, and information about horizontal and vertical coordinates of a reproduction image of the at least one paired view image.

15. A computer-readable recording medium having recorded thereon a program for executing the method of claim 2, by using a computer.

12. A multiview still image service providing apparatus comprising:

a multiview still image file format configuring unit which configures a multiview still image file format comprising a plurality of image areas;

an image information inserting unit which inserts a plurality of pieces of image information corresponding to a multiview still image into the plurality of image areas, respectively;

an attribute information inserting unit which inserts 3D basic attribute information to three-dimensionally reproduce the multiview still image into a first image area of the plurality of image areas; and

an output unit which outputs multiview still image data comprising the plurality of pieces of image information based on the multiview still image file format,

wherein main-view image information from among the plurality of pieces of image information is inserted into the first image area.

13. A multiview still image service receiving apparatus comprising:

a receiving and parsing unit which receives and parses multiview still image data based on a multiview still image file format comprising a plurality of image areas;

an attribute information extracting unit which extracts 3D basic attribute information to three-dimensionally reproduce a multiview still image from a first image area of the plurality of image areas;

an image information extracting unit which extracts main-view image information, from among a plurality of pieces of image information forming the multiview still image, from the first image area, and extracts remaining pieces of image information from among the plurality of pieces of image information from remaining image areas of the plurality of image areas, respectively; and

an image restoring unit which restores multiple view images that form the multiview still image, by using the extracted 3D basic attribute information and the plurality of pieces of extracted image information,

wherein the main-view image information is inserted into the first image area.

22. A method of providing a media file format-based multiview still image service, the method comprising:

inserting at least one image data having a still image file format into a media data area of a media file format;

inserting 3D metadata comprising information to three-dimensionally reproduce multiview still image data into a moov area of the media file format; and

outputting the multiview still image data comprising a plurality of pieces of image information based on the media file format,

wherein the still image file format is a format into which the plurality of pieces of image information corresponding to a multiview still image are inserted.

24. A computer-readable recording medium having recorded thereon a program for executing the method of claim 22, by using a computer.

23. A method of receiving a media file format-based multiview still image service, the method comprising:

receiving and parsing multiview still image data based on a media file format;

extracting 3D metadata from a moov area of the media file format,;

extracting at least one image data that has a still image file format and comprises image information about multiple view images corresponding to a multiview still image, from a media data area of the media file format; and

restoring the multiple view images corresponding to the multiview still image, by using the extracted 3D metadata and the plurality of pieces of extracted image information,

wherein the 3D metadata comprises information to restore the multiple view images corresponding to the multiview still image and to three-dimensionally reproduce the multiple view images.

25. A computer-readable recording medium having recorded thereon a program for executing the method of claim 23, by using a computer.