MULTI-VIEW DISPLAYS AND ASSOCIATED SYSTEMS AND METHODS

• US 20170085867A1
• Filed: 09/16/2016
• Published: 03/23/2017
• Est. Priority Date: 09/17/2015
• Status: Active Grant

• Current Assignee: Fathom Optics Incorporated
• Original Assignee: LUMII, Inc.
• Inventors: Baran, Thomas Anthony, Hirsch, Matthew Waggener, Leithinger, Daniel
• Granted Patent: US 10,070,118 B2
• Time in Patent Office: Days
• CPC Class Codes: B41M 3/008 Sequential or multiple printing, e.g. on previously printed background; Mirror printing; Recto-verso printing; using a combination of different printing techniques; Printing of patterns visible in reflection and by transparency; by superposing printed artifacts
• CPC Class Codes: B41M 3/06 Veined printings; Fluorescent printings; Stereoscopic images; Imitated patterns, e.g. tissues, textiles
• CPC Class Codes: B44F 7/00 Designs imitating three-dimensional effects
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/351 for displaying simultaneously

Abstract

Techniques for controlling optical behavior of a multi-view display apparatus comprising a first layer comprising first optical elements and a second layer comprising second optical elements. The techniques include obtaining a plurality of scene views; obtaining information specifying a model of the multi-view display apparatus; obtaining information specifying at least one blurring transformation; and generating actuation signals for controlling the multi-view display apparatus to concurrently display a plurality of display views corresponding to the plurality of scene views, the actuation signals comprising first actuation signals for controlling the first optical elements and second actuation signals for controlling the second optical elements, the generating comprising: generating the first actuation signals and the second actuation signals based, at least in part, on the plurality of scene views, the information specifying the model of the multi-view display apparatus, and the information specifying the at least one blurring transformation.

Claims

1. A system for generating actuation signals to control optical behavior of a multi-view display apparatus, the multi-view display apparatus comprising at least two different layers including a first layer comprising a first plurality of optical elements and a second layer comprising a second plurality of optical elements, the system comprising:

at least one processor;

at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one processor, cause the at least one processor to perform;

obtaining a plurality of scene views;

obtaining information specifying a model of the multi-view display apparatus;

obtaining information specifying at least one blurring transformation; and

generating a plurality of actuation signals for controlling the multi-view display apparatus to concurrently display a plurality of display views corresponding to the plurality of scene views, the plurality of actuation signals comprising a first plurality of actuation signals for controlling the first plurality of optical elements and a second plurality of actuation signals for controlling the second plurality of optical elements, the generating comprising;

generating the first plurality of actuation signals and the second plurality of actuation signals based, at least in part, on the plurality of scene views, the information specifying the model of the multi-view display apparatus, and the information specifying the at least one blurring transformation.

2. The system of claim 1, wherein the at least one processor is further configured to perform:

providing the first plurality of actuation signals and the second plurality of actuation signals to circuitry for controlling the multi-view display apparatus.

3. The system of claim 2, further comprising:

the circuitry for controlling the multi-view display apparatus; and

the multi-view display apparatus,

wherein the circuitry is configured to;

control the first plurality of optical elements using the first plurality of the actuation signals; and

control the second plurality of optical elements using the second plurality of the actuation signals.

4. The system of claim 1, wherein obtaining the information specifying the at least one blurring transformation comprises obtaining information specifying a plurality of blurring transformations corresponding to the plurality of scene views.

5. The system of claim 1, wherein generating the plurality of actuation signals comprises:

obtaining a plurality of display views corresponding to the plurality of scene views; and

applying the at least one blurring transformation to at least one of the plurality of display views and a corresponding at least one of the plurality of scene views.

6. The system of claim 5, wherein the at least one blurring transformation comprises at least one band-limiting function, and wherein applying the at least one blurring transformation to the at least one of the plurality of display views comprises applying the at least one band-limiting function to the at least one of the plurality of display views.

7. The system of claim 5, wherein applying the at least one blurring transformation to the at least one of the plurality of display views comprises processing the plurality of display views to obtain images having reduced high-frequency content as compared to the plurality of display views.

8. The system of claim 5, wherein applying the at least one blurring transformation to the at least one of the plurality of display views comprises convolving the at least one of the plurality of display views with a point spread function of an optical system.

9. The system of claim 5, wherein applying the at least one blurring transformation to the at least one of the plurality of display views comprises spatially convolving the at least one of the plurality of display views with a kernel representing a shape of an aperture or a frequency-domain representation of the shape of the aperture.

10. The system of claim 5, wherein applying the at least one blurring transformation to the at least one of the plurality of display views comprises spatially convolving the at least one of the plurality of display views with a two-dimensional Gaussian function.

11. The system of claim 5, wherein applying the at least one blurring transformation to the at least one of the plurality of display views comprises applying a binary morphological transform to the at least one of the plurality of display views.

14. The system of claim 1, wherein generating the plurality of actuation signals comprises:

generating an initial set of actuation signals;

iteratively updating the initial set of actuation signals to produce a sequence of intermediate sets of actuation signals; and

outputting a last set of actuation signals in the sequence of intermediate sets of actuation signals as the plurality of actuation signals.

15. The system of claim 14, wherein the sequence of intermediate sets of actuation signals includes a first set of actuation signals and a second set of actuation signals, and wherein the iteratively updating comprises:

updating the first set of actuation signals to obtain the second set of actuation signals based, at least in part, on the plurality of scene views, the information specifying the model of the multi-view display apparatus, and the information specifying the at least one blurring transformation.

16. The system of claim 15, wherein updating the first set of actuation signals comprises:

determining, using the information specifying the model of the multi-view display apparatus and the first set of actuation signals, a first set of display views corresponding to display views that would be generated by the multi-view display apparatus if the first set of actuation signals were used to control the multi-view display apparatus;

determining, using the at least one blurring transformation, a measure of error between the first set of display views and the plurality of scene views; and

updating the first set of actuation signals based on the measure of error between the first set of display views and the plurality of scene views.

17. The system of claim 16, wherein updating the first set of actuation signals based on the measure of error between the first set of display views and the plurality of scene views comprises multiplicatively updating the first set of actuation signals subject to non-negativity constraints of the actuation signals.

18. The system of claim 1, wherein obtaining a plurality of scene views comprises obtaining a set of scene views corresponding to a respective set of positions of a viewer of the multi-view display apparatus.

19. The system of claim 1, wherein obtaining the information specifying the model of the multi-view display apparatus comprises obtaining information characterizing at least one physical characteristic selected from the group consisting of:

a distance between the first layer and the second layer, a relative location of the first layer to the second layer, a resolution of the first layer, a resolution of the second layer, a size of the first layer, a size of the second layer, and a representation of spectral cross-talk between color channels of the first layer and the second layer.

20. The system of claim 1, wherein the processor-executable instructions further cause the at least one processor to:

obtain an indication that color content is to be displayed on the first layer and grayscale content is to be displayed on the second layer,

wherein generating the plurality of actuation signals is performed further based on the indication such that when the first plurality of actuation signals are used to control the first layer, the first layer displays color content and when the second plurality of actuation signals are used to control the second layer, the second layer displays grayscale content.

12. (canceled)

13. (canceled)

21. A method for generating actuation signals to control optical behavior of a multi-view display apparatus, the multi-view display apparatus comprising at least two different layers including a first layer comprising a first plurality of optical elements and a second layer comprising a second plurality of optical elements, the method comprising:

using at least one processor configured to perform;

obtaining a plurality of scene views;

obtaining information specifying a model of the multi-view display apparatus;

obtaining information specifying at least one blurring transformation; and

generating a plurality of actuation signals for controlling the multi-view display apparatus to concurrently display a plurality of display views corresponding to the plurality of scene views, the plurality of actuation signals comprising a first plurality of actuation signals for controlling the first plurality of optical elements and a second plurality of actuation signals for controlling the second plurality of optical elements, the generating comprising;

generating the first plurality of actuation signals and the second plurality of actuation signals based, at least in part, on the plurality of scene views, the information specifying the model of the multi-view display apparatus, and the information specifying the at least one blurring transformation.

22. At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for generating actuation signals to control optical behavior of a multi-view display apparatus, the multi-view display apparatus comprising at least two different layers including a first layer comprising a first plurality of optical elements and a second layer comprising a second plurality of optical elements, the method comprising:

obtaining a plurality of scene views;

obtaining information specifying a model of the multi-view display apparatus;

obtaining information specifying at least one blurring transformation; and

generating a plurality of actuation signals for controlling the multi-view display apparatus to concurrently display a plurality of display views corresponding to the plurality of scene views, the plurality of actuation signals comprises a first plurality of actuation signals for controlling the first plurality of optical elements and a second plurality of actuation signals for controlling the second plurality of optical elements, the generating comprising;

generating the first plurality of actuation signals and the second plurality of actuation signals based, at least in part, on the plurality of scene views, the information specifying the model of the multi-view display apparatus, and the information specifying the at least one blurring transformation.

23-58. -58. (canceled)