Multi-view image display apparatus and multi-view image display method thereof

• US 9,035,943 B1
• Filed: 04/17/2014
• Issued: 05/19/2015
• Est. Priority Date: 11/13/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Ho-young, Han, Seung-ryong
• Primary Examiner(s): Tseng, Charles
• Application Number:
  US14/255,633
• Publication Number:
  US 20150130793A1
• Time in Patent Office: 397 Days
• Field of Search: 345/419, 345/422
• US Class Current: 345/419
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/351 for displaying simultaneously

Abstract

A multi-view image display apparatus is disclosed. The multi-view image display apparatus includes a depth adjuster configured to adjust depth of an input image, a rendering unit configured to perform rendering of a multi-view based on the depth-adjusted image, a display configured to arrange and display the multi-view image according to an arrangement pattern, and a controller configured to control the depth adjuster to shift depth of the input image so that an object satisfying a criterion has a depth value, based on depth information of at least one object included in the input image.

Claims

1. A multi-view image display apparatus, comprising:

a depth adjuster configured to adjust depth of an input image;

a rendering unit configured to perform rendering of a multi-view based on the depth-adjusted image;

a display configured to arrange and display the multi-view image according to an arrangement pattern; and

a controller configured to control the depth adjuster to shift the depth of the input image so that a first object satisfying a criterion has a first depth value, based on depth information of at least two objects included in the input image, wherein the first object is one of the at least two objects,

wherein a second object from among the at least two objects is shifted based on an amount which said first object is shifted,

wherein the controller, based on information on each depth section providing a viewer with a same degree of three-dimensional effect, adjusts the depth of the first object included in the input image to the first depth value which is close to a focal plane at a depth section providing a same degree of three-dimensional effect as prior to said adjustment.

2. The apparatus as claimed in claim 1, wherein the first depth value is a preset depth value corresponding to a focal plane in a depth map.

3. The apparatus as claimed in claim 1, wherein the controller determines the first object satisfying the criterion based on a second depth value of at least one object from among the at least two objects included in the input image and a size of a pixel region which the first object occupies.

4. The apparatus as claimed in claim 2, further comprising:

a storage configured to store the information on each depth section providing the viewer with the same degree of three-dimensional effect.

5. The apparatus as claimed in claim 1, wherein at least one from among the criterion and the arrangement pattern is preset.

6. A multi-view image display apparatus, comprising:

a depth adjuster configured to adjust depth of an input image;

a rendering unit configured to perform rendering of a multi-view based on the depth-adjusted image;

a display configured to arrange and display the multi-view image according to an arrangement pattern; and

a controller configured to control the depth adjuster to shift the depth of the input image so that a first object satisfying a criterion has a first depth value, based on depth information of at least two objects included in the input image, wherein the first object is one of the at least two objects,

wherein a second object from among the at least two objects is shifted based on an amount which said first object is shifted,

wherein the controller determines the first object satisfying the criterion based on a second depth value of at least one object from among the at least two objects included in the input image and a size of a pixel region which the first object occupies, and

wherein the controller shifts depth of the input image so that an object, from among the at least two objects, having a greater pixel size is arranged on a focal plane by comparing a first pixel size of a rear ground object having a third depth value less than the first depth value with a second pixel size of a foreground image having a fourth depth value greater than the first depth value.

7. A multi-view image display apparatus, comprising:

a depth adjuster configured to adjust depth of an input image;

a rendering unit configured to perform rendering of a multi-view based on the depth-adjusted image;

a display configured to arrange and display the multi-view image according to an arrangement pattern; and

a controller configured to control the depth adjuster to shift the depth of the input image so that a first object satisfying a criterion has a first depth value, based on depth information of at least two objects included in the input image, wherein the first object is one of the at least two objects,

wherein a second object from among the at least two objects is shifted based on an amount which said first object is shifted,

wherein the controller determines the first object satisfying the criterion based on a second depth value of at least one object from among the at least two objects included in the input image and a size of a pixel region which the first object occupies, and

wherein when a first pixel size of a rear ground object, from among the at least two objects, having a third depth value less than the first depth value is the same as a second pixel size of a foreground image having a fourth depth value greater than the first depth value, the controller shifts the depth of the input image so that the rear ground object is arranged on a focal plane.

8. A multi-view image display apparatus, comprising:

a depth adjuster configured to adjust depth of an input image;

a rendering unit configured to perform rendering of a multi-view based on the depth-adjusted image;

a display configured to arrange and display the multi-view image according to an arrangement pattern; and

a controller configured to control the depth adjuster to shift the depth of the input image so that a first object satisfying a criterion has a first depth value, based on depth information of at least one object included in the input image,

wherein when the depth of the input image is shifted so that a second object has a second depth value, the controller determines an object in which swim effect is minimized at a section where the multi-view image is arranged in reverse order of the arrangement pattern, and where pseudo stereo occurs, as the first object satisfying the criterion.

9. The apparatus as claimed in claim 8, wherein, when the multi-view image is a total of N views, the arrangement pattern is a repeat of a pattern where 1^st view to N/2th view are arranged sequentially and then N/2−

1th view to 1^st view are arranged in reverse order, or a repeat of a pattern where one view from among odd views and even views of 1^st view to Nth view is arranged sequentially and then the other remaining view from among odd views and even views of Nth view to 1^st view is arranged in reverse order.

10. A method for displaying a multi-view image of a multi-view image apparatus, the method comprising:

adjusting depth, by a controller of the multi-view image apparatus, by shifting depth of an input image so that a first object satisfying a criterion has a first depth value, based on depth information of at least two objects included in the input image, wherein the first object is one of the at least two objects;

performing rendering of a multi-view image based on the depth-adjusted image; and

arranging and displaying the multi-view image as an arrangement pattern,

wherein a second object from among the at least two objects is shifted based on an amount which said first object is shifted, and

wherein the adjusting the depth comprises, based on information on each depth section providing a viewer with a same degree of three-dimensional effect, adjusting the depth of the first object included in the input image to the first depth value which is close to a focal plane at a depth section providing a same degree three-dimensional effect as prior to said adjustment.

11. The method as claimed in claim 10, wherein the first depth value is a preset depth value corresponding to the focal plane in a depth map.

12. The method as claimed in claim 10, wherein the adjusting the depth comprises determining the first object satisfying the criterion based on a second depth value of at least one object from among the at least two objects included in the input image and a size of a pixel region which the first object occupies.

13. The method as claimed in claim 10, wherein at least one from among the criterion and the arrangement pattern is preset.

14. A method for displaying a multi-view image of a multi-view image apparatus, the method comprising:

adjusting depth, by a controller of the multi-view image apparatus, by shifting depth of an input image so that a first object satisfying a criterion has a first depth value, based on depth information of at least two objects included in the input image, wherein the first object is one of the at least two objects;

performing rendering of a multi-view image based on the depth-adjusted image; and

arranging and displaying the multi-view image as an arrangement pattern,

wherein a second object from among the at least two objects is shifted based on an amount which said first object is shifted,

wherein the adjusting the depth comprises determining the first object satisfying the criterion based on a second depth value of at least one object from among the at least two objects included in the input image and a size of a pixel region which the first object occupies, and

wherein the adjusting the depth comprises, from among the at least two objects, shifting depth of the input image so that an object having a greater pixel size is arranged on a focal plane, by comparing a first pixel size of a rear ground object having a third depth value less than the first depth value with a second pixel size of a foreground image having a fourth depth value greater than the first depth value.

15. A method for displaying a multi-view image of a multi-view image apparatus, the method comprising:

adjusting depth, by a controller of the multi-view image apparatus, by shifting depth of an input image so that a first object satisfying a criterion has a first depth value, based on depth information of at least two objects included in the input image, wherein the first object is one of the at least two objects;

performing rendering of a multi-view image based on the depth-adjusted image; and

arranging and displaying the multi-view image as an arrangement pattern,

wherein a second object from among the at least two objects is shifted based on an amount which said first object is shifted,

wherein the adjusting the depth comprises determining the first object satisfying the criterion based on a second depth value of at least one object from among the at least two objects included in the input image and a size of a pixel region which the first object occupies, and

wherein the adjusting the depth comprises, when a first pixel size of a rear ground object, from among the at least two objects, having a third depth value less than the first depth value is the same as a second pixel size of a foreground image having a fourth depth value greater than the first depth value, shifting depth of the input image so that the rear ground object is arranged on a focal plane.

16. A method for displaying a multi-view image of a multi-view image apparatus, the method comprising:

adjusting depth, by a controller of the multi-view image apparatus, by shifting depth of an input image so that a first object satisfying a criterion has a first depth value, based on depth information of at least two objects included in the input image, wherein the first object is one of the at least two objects;

performing rendering of a multi-view image based on the depth-adjusted image; and

arranging and displaying the multi-view image as an arrangement pattern,

wherein a second object from among the at least two objects is shifted based on an amount which said first object is shifted, and

wherein the adjusting the depth comprises, when depth of the input image is shifted so that a second object has a second depth value, determining an object in which swim effect is minimized at a section where the multi-view image is arranged in reverse order at the arrangement pattern and where pseudo stereo occurs, as the first object satisfying the criterion.

17. The method as claimed in claim 16, wherein, when the multi-view image is a total of N views, the arrangement pattern is a repeat of a pattern where 1^st view to N/2th view are arranged sequentially and then N/2−

1th view to 1^st view are arranged in reverse order, or a repeat of a pattern where one view from among odd views and even views of 1^st view to Nth view is arranged sequentially and then the other remaining view from among odd views and even views of Nth view to 1^st view is arranged in reverse order.

18. A multi-view image display apparatus, comprising:

a depth adjuster configured to adjust depth of an input image;

a rendering unit configured to perform rendering of a multi-view based on the depth-adjusted image;

a display configured to arrange and display the multi-view image;

and a controller configured to determine which first object from among a plurality of objects of the input image to shift toward a focal plane and control the depth adjuster to shift a depth of the first object and shift a second object from among the plurality of objects based on the shifting of the first object,

wherein the second object is shifted based on an amount which the first object is shifted, and

wherein the controller, based on information on each depth section providing a viewer with a same degree of three-dimensional effect, adjusts the depth of the first object included in the input image to the first depth value which is close to the focal plane at a depth section providing a same degree of three-dimensional effect as prior to said adjustment.