Content-adaptive multi-focal display

• US 9,866,826 B2
• Filed: 03/09/2015
• Issued: 01/09/2018
• Est. Priority Date: 11/25/2014
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Wu, Wanmin, Llull, Patrick, Tosic, Ivana, Berkner, Kathrin, Bedard, Noah
• Primary Examiner(s): He, Yingchun
• Application Number:
  US14/642,095
• Publication Number:
  US 20160148416A1
• Time in Patent Office: 1,037 Days
• Field of Search: None
• CPC Class Codes: H04N 13/322 using varifocal lenses or mirrors
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes

Abstract

A multi-focal display represents a 3-dimensional scene by a series of 2-dimensional images located at different focal planes. The locations of the focal planes are selected based on an analysis of the three-dimensional scene to be rendered by the multi-focal display.

Claims

1. A computer-implemented method for selecting locations of focal planes for a multi-focal display in order for the multi-focal display to render actual content from a three-dimensional scene, the method comprising:

analyzing the actual content from the three-dimensional scene to be rendered by the multi-focal display;

selecting the locations of the focal planes based on the analysis of the actual content, wherein selecting the locations of the focal planes comprises selecting the locations based on K-means clustering of the locations of points in the three-dimensional scene;

configuring the multi-focal display according to the selected locations of the focal planes; and

rendering the actual content on the multi-focal display in said configuration.

2. The method of claim 1

wherein the selected locations are non-uniformly spaced over an operating range of the multi-focal display.

3. The method of claim 1 wherein analyzing the actual content and selecting the locations of the focal planes occurs in real-time.

4. The method of claim 1 wherein the multi-focal display renders scenes using not more than six focal planes.

5. The method of claim 1 wherein analyzing the actual content comprises analyzing the actual content from the three-dimensional scene in a spatial domain, and selecting the locations of the focal planes comprises selecting the locations of the focal planes based on the analysis in the spatial domain.

6. The method of claim 1 wherein analyzing the actual content comprises analyzing the actual content from the three-dimensional scene in a spatial frequency domain, and selecting the locations of the focal planes comprises selecting the locations of the focal planes based on the analysis in the spatial frequency domain.

7. The method of claim 1 wherein selecting the locations of the focal planes is further based on rendering requirements of the multi-focal display.

8. The method of claim 1 further comprising selecting a number M of focal planes based on the analysis of the actual content.

9. The method of claim 1 wherein the multi-focal display is a near-eye multi-focal display.

10. A multi-focal display for rendering actual content from a three-dimensional scene by using a plurality of focal planes at different locations, the locations of the focal planes determined based on analysis of the actual content of the three-dimensional scene to be rendered, wherein selecting the locations of the focal planes comprises selecting the locations based on K-means clustering of the locations of points in the three-dimensional scene, the multi-focal display configurable according to the selected locations of the focal planes and rendering the actual content in said configuration.

11. The multi-focal display of claim 10 wherein the selected locations are non-uniformly spaced over an operating range of the multi-focal display.

12. The multi-focal display of claim 10 wherein analyzing the actual content and selecting the locations of the focal planes occurs in real-time.

13. The multi-focal display of claim 10 wherein the multi-focal display renders scenes using not more than six focal planes.

14. The multi-focal display of claim 10 wherein analyzing the actual content comprises analyzing the actual content from the three-dimensional scene in a spatial domain, and selecting the locations of the focal planes comprises selecting the locations of the focal planes based on the analysis in the spatial domain.

15. The multi-focal display of claim 10 wherein analyzing the actual content comprises analyzing the actual content from the three-dimensional scene in a spatial frequency domain, and selecting the locations of the focal planes comprises selecting the locations of the focal planes based on the analysis in the spatial frequency domain.

16. The multi-focal display of claim 10 wherein selecting the locations of the focal planes is further based on rendering requirements of the multi-focal display.

17. The multi-focal display of claim 10 wherein the multi-focal display is a near-eye multi-focal display.

18. A computer program product for use with a computer, the computer program product comprising a non-transitory computer readable medium having a computer program code embodied therein for selecting locations of focal planes for a multi-focal display in order for the multi-focal display to render actual content from a three-dimensional scene, the computer program code performing the steps of:

analyzing the actual content from the three-dimensional scene to be rendered by the multi-focal display;

selecting the locations of the focal planes based on the analysis of the actual content, wherein selecting the locations of the focal planes comprises selecting the locations based on K-means clustering of the locations of points in the three-dimensional scene;

configuring the multi-focal display according to the selected locations of the focal planes; and

rendering the actual content on the multi-focal display in said configuration.

19. The computer program product of claim 18 wherein the selected locations are non-uniformly spaced over an operating range of the multi-focal display.

20. The computer program product of claim 18 wherein analyzing the actual content and selecting the locations of the focal planes occurs in real-time.