Multi view image display apparatus and control method thereof

• US 10,212,416 B2
• Filed: 02/08/2016
• Issued: 02/19/2019
• Est. Priority Date: 09/24/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Han, Seung-ryong, Kang, Jin-mo, Lee, Ho-young
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): Brown, Jr., Howard D
• Application Number:
  US15/018,035
• Publication Number:
  US 20170094266A1
• Time in Patent Office: 1,107 Days
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/317 using slanted parallax optics
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/351 for displaying simultaneously
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

A multi view image display apparatus and a control method thereof are provided. The display apparatus includes an image inputter configured to receive an image, a display configured to display a multi view image that is generated based on the received image, and a processor configured to render views having different viewpoints based on a depth of the received image, expand a normal viewing area based on a cyclic mapping, adjust pixel values of the views so that a view jumping amount of a view jumping area occurring on a reverse viewing area due to the expansion of the normal viewing area is equal to a value, and generate the multi view image based on the adjusted pixel values.

Claims

1. A multi view image display apparatus comprising:

an image receiver;

a display; and

a processor configured to;

render a plurality of views of different viewpoints, based on a depth of an image received through the image receiver;

expand a normal viewing section, based on a cyclic mapping, the normal viewing section being a section in which viewpoints of views included in the section are increased sequentially;

adjust pixel values of the plurality of views, based on the expanded normal viewing section;

obtain a multi view image, based on the adjusted pixel values; and

control the display to display the multi view image,

wherein a view jumping amount of a view jumping area occurring on a reverse viewing section based on the adjusted pixel values is equal to a predetermined value, and

wherein the reverse viewing section being a section in which viewpoints of views included in the section are decreased sequentially.

2. The multi view image display apparatus of claim 1, wherein the display comprises a display panel configured to display the multi view image, and a view field divider disposed on a front face of the display panel, the view field divider being configured to provide optical views having different viewpoints on a viewing area of a user, and

a number of the plurality of views is greater than a number of the optical views.

3. The multi view image display apparatus of claim 1, wherein the processor is further configured to expand the normal viewing section on an epipolar domain that is obtained based on an epipolar image comprising uniform pixel lines of each of the plurality of views.

4. The multi view image display apparatus of claim 1, wherein the processor is further configured to:

calculate a number of views to be used to expand the normal viewing section, and a depth difference between the views, based on the depth of the received image; and

render the views, based on the number of views and the depth difference.

5. The multi view image display apparatus of claim 1, wherein the processor is further configured to:

smooth a depth difference between views occurring on the view jumping area; and

obtain the multi view image, further based on the smoothed depth difference.

6. The multi view display apparatus of claim 1, wherein the processor is further configured to:

calculate a threshold slope so that the view jumping amount of the view jumping area is equal to a value, based on a depth difference between the views that are provided on the normal viewing section;

process the received image with at least one among a depth slope of the received image and the threshold slope, based on a difference between the depth slope and the threshold slope; and

obtain the multi view image, based on the processed image.

7. The multi view image display apparatus of claim 1, further comprising:

a storage configured to store a threshold slope that is determined so that the view jumping amount of the view jumping area is equal to a value, based on a depth difference between the views that are provided on the normal viewing section,

wherein the processor is further configured to;

process the received image with at least one among a depth slope of the received image and the threshold slope, based on a difference between the depth slope and the threshold slope; and

obtain the multi view image, based on the processed image.

8. The multi view image display apparatus of claim 7, wherein the processor is further configured to:

determine whether the depth slope is greater than the threshold slope; and

process the received image with the threshold slope, in response to the processor determining that the depth slope is greater than the threshold slope.

9. The multi view image display apparatus of claim 7, wherein the processor is further configured to:

determine whether the depth slope is greater than the threshold slope, and whether the multi view image display apparatus operates in a display mode maintaining the depth slope; and

compensate a depth slope of the reverse viewing section with the threshold slope, in response to the processor determining that the depth slope is greater than the threshold slope, and that the multi view image display apparatus operates in the display mode.

10. The multi view image display apparatus of claim 7, wherein the processor is further configured to:

determine whether the depth slope is less than the threshold slope; and

expand the normal viewing section, based on the depth slope of the received image, in response to the processor determining that the depth slope is less than the threshold slope.

11. The multi view image display apparatus of claim 1, further comprising:

a user interface configured to receive a user command,

wherein the processor is further configured to expand the normal viewing section, based on the cyclic mapping and a 3D feeling that is determined based on the user command.

12. A control method of a multi view image display apparatus, the method comprising:

rendering a plurality of views of different viewpoints, based on a depth of an image that is received;

expanding a normal viewing section, based on a cyclic mapping, the normal viewing section being a section in which viewpoints of views included in the section are increased sequentially;

adjusting pixel values of the plurality of views, based on the expanded normal viewing section;

obtaining a multi view image, based on the adjusted pixel values; and

displaying the multi view image,

wherein a view jumping amount of a view jumping area occurring on a reverse viewing section based on the adjusted pixel values is equal to a predetermined value, and

wherein the reverse viewing section being a section in which viewpoints of views included in the section are decreased sequentially.

13. The control method of claim 12, further comprising providing optical views having different viewpoints on a viewing area of a user, and

wherein a number of the plurality of views is greater than a number of the optical views.

14. The control method of claim 12, wherein the expanding comprises expanding the normal viewing section on an epipolar domain that is obtained based on an epipolar image comprising uniform pixel lines of each of the plurality of views.

15. The control method of claim 12, further comprising calculating a number of views to be used to expand the normal viewing section, and a depth difference between the views, based on the depth of the received image,

wherein the rendering comprises rendering the views, based on the calculating.

16. The control method of claim 12, further comprising smoothing a depth difference between views occurring on the view jumping area,

wherein the obtaining the multi view image comprises obtaining the multi view image, further based on the smoothed depth difference.

17. The control method of claim 12, further comprising:

calculating a threshold slope so that the view jumping amount of the view jumping area is equal to a value, based on a depth difference between the views that are provided on the normal viewing section; and

processing the received image with at least one among a depth slope of the image and the threshold slope, based on a difference between the depth slope and the threshold slope,

wherein the obtaining the multi view image comprises obtaining the multi view image, based on the processed image.

18. The control method of claim 12, further comprising:

storing a threshold slope that is determined so that the view jumping amount of the view jumping area is equal to a value, based on a depth difference between the views that are provided on the normal viewing section; and

processing the received image with at least one among a depth slope of the received image and the threshold slope, based on a difference between the depth slope and the threshold slope,

wherein the obtaining the multi view image comprises obtaining the multi view image, based on the processed image.

19. A multi view image display apparatus comprising:

a display; and

a processor configured to;

render a plurality of different views of an image, based on a depth of the image;

expand a normal viewing section of views, based on a cyclic mapping, the normal viewing section being a section in which viewpoints of views included in the section are increased sequentially;

adjust pixel values of the plurality of views, based on the expanded normal viewing section;

obtain a multi view image, based on the adjusted pixel values; and

control the display the multi view image,

wherein a view jumping amount of a view jumping area occurring on a reverse viewing section based on the adjusted pixel values is equal to a predetermined value, and

wherein the reverse viewing section being a section in which viewpoints of views included in the section are decreased sequentially.

20. The multi view image display apparatus of claim 19, wherein the processor is further configured to:

determine whether a depth slope of the normal viewing section is greater than a threshold slope, and whether the multi view image display apparatus operates in a display mode maintaining the depth slope;

compensate a depth slope of the reverse viewing section with the threshold slope, in response to the processor determining that the depth slope is greater than or equal to the threshold slope, and that the multi view image display apparatus operates in the display mode; and

expand the normal viewing section, based on the depth slope of the normal viewing section, in response to the processor determining that the depth slope is less than the threshold slope.