Rendering of image data for multi-view display

• US 9,532,038 B2
• Filed: 10/31/2006
• Issued: 12/27/2016
• Est. Priority Date: 11/04/2005
• Status: Active Grant

• Current Assignee: Leia Inc.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Berretty, Robert-Paul Mario
• Primary Examiner(s): Etienne, Ario
• Assistant Examiner(s): RUBIN, BLAKE J
• Application Number:
  US12/091,944
• Publication Number:
  US 20080291268A1
• Time in Patent Office: 3,710 Days
• Field of Search: 348/51
• US Class Current: 1/1
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/125 for crosstalk reduction
• CPC Class Codes: H04N 13/351 for displaying simultaneously

Abstract

The invention pertains to rendering of image data for a multi-view display, such as image data for a lenticular auto-stereoscopic display. The method comprising the steps of providing view-dependent image data for an image, determining a view-dependent intensity function, or luminance function, for the image, applying a spatial filtering to a view-dependent coordinate of the intensity function, the spatial filtering being such as a low-pass filter, a high-pass filter or a combination of a low-pass and a high-pass filter, and sampling the view-dependent intensity function to a plurality of sub-images, each sub-image being associated with a view-direction of the image.

Claims

1. Method for rendering image data for a multi-view display, the method comprising the steps of:

providing, via an input, view-dependent image data for an image;

determining, via a processor, a view-dependent intensity function L(x, y, φ

) for the image from the view-dependent image data, for (i) each position (x,y) on the multi-view display and (ii) a viewing angle (φ

), wherein the view-dependent intensity function describes an intensity of emission from the multi-view display as a function of the viewing angle (φ

) for each position (x,y) of the multiview display, and further wherein the viewing angle (φ

) comprises a view-dependent coordinate that represents a horizontal view direction of a viewer with respect to a centerline of the display panel;

applying spatial filtering, via a spatial filter, to the view-dependent intensity function as a function of the viewing angle (φ

) to provide a spatial filtered view-dependent intensity function; and

sampling, via an output, after the spatial filtering, the spatial filtered view-dependent intensity function to a plurality of sub-images, each sub-image being associated with a view-direction of the image at a position of a group of pixels on the multi-view display, wherein light emitted from each group of pixels is directed into an angular distribution associated with the view direction of the respective group of pixels and provides separate images to the viewer'"'"'s eyes.

2. Method according to claim 1, wherein the spatial filter is a high-pass filter.

3. Method according to claim 1, wherein the spatial filter is a low-pass filter.

4. Method according to claim 1, wherein the spatial filter is a combination of a high-pass filter and a low-pass filter.

5. Method according to claim 2, wherein the high-pass filter applies positive gain to frequencies above a predetermined frequency.

6. Method according to claim 3, wherein frequencies above the Nyquist frequency are removed in the low-pass filtering.

7. Method according to claim 1, wherein the view-dependent intensity function is determined for at least one color component of the image, and wherein the spatial filtering is applied to the at least one color component of the image.

8. Method according to claim 1, wherein the view-dependent intensity function is generated in accordance with a configuration of an optical element.

9. Method according to claim 1, wherein the view-dependent intensity function is generated from an image format including color and depth information.

10. Method according to claim 1, wherein the view-dependent intensity function is generated from a multitude of images.

11. Method according to claim 1, wherein the view-dependent intensity function is sampled to an arbitrary number of view-directions.

12. Method according to claim 1, wherein an image format of the image data is a 2.5D video image format.

15. A non-transient computer readable medium encoded with computer program code executable by a processor for implementing the method of claim 1.

13. Multi-view display device comprising:

a display panel including an array of display elements, the display elements being arranged in groups, each group being associated with a view-direction of an image;

an optical element for directing light emitted from the display panel, so that light emitting from a group of display elements is directed into an angular distribution associated with the view-direction of the group;

an input module for receiving view-dependent image data for an image;

a rendering module for determining a view-dependent intensity function L(x, y, φ

) for the image from the view-dependent image data, for (i) each position (x,y) on the display panel and (ii) a viewing angle (φ

), wherein the view-dependent intensity function describes an intensity of emission from the display panel as a function of the viewing angle (φ

) and for applying a spatial filtering to a view-dependent coordinate of the view-dependent intensity function as a function of the viewing angle (φ

) to provide a spatial filtered view-dependent intensity function for each position (x,y) of the multiview display device, and further wherein the viewing angle (φ

) comprises a view-dependent coordinate that represents a horizontal view direction of a viewer with respect to a centerline of the display panel; and

an output module for outputting the spatial filtered view-dependent intensity function to a plurality of sub-images, each sub-image being associated with a group of display elements and a view-direction of the image at a position of a group of pixels on the display panel, wherein light emitted from each group of pixels is directed into an angular distribution associated with the view direction of the respective group of pixels and provides separate images to the viewer'"'"'s eyes.

14. Signal rendering system comprising:

an input module for receiving view-dependent image data for an image;

a rendering module for determining a view-dependent intensity function L(x, y, φ

) for the image from the view-dependent image data, for (i) each position (x,y) on a display panel and (ii) a viewing angle (φ

), wherein the view-dependent intensity function describes an intensity of emission from the display panel as a function of the viewing angle (φ

) for each position (x,y) of the display panel, and further wherein the viewing angle (φ

) comprises a view-dependent coordinate represents a horizontal view direction of a viewer with respect to a centerline of the display panel, and for applying a spatial filtering to the view-dependent coordinate of the view-dependent intensity function as a function of the viewing angle (φ

) to provide a spatial filtered view-dependent intensity function; and

an output module for outputting the spatial filtered view-dependent intensity function to a plurality of sub-images, each sub-image being associated with a group of display elements and a view-direction of the image at a position of a group of pixels on the display panel, wherein light emitted from each group of pixels is directed into an angular distribution associated with the view direction of the respective group of pixels and provides separate images to the viewer'"'"'s eyes, and wherein the input module, the rendering module and the output module comprise non-transient entities implemented in hardware, software, firmware or any combination of these.