Optimization of a multi-view display

• US 10,356,399 B2
• Filed: 11/23/2015
• Issued: 07/16/2019
• Est. Priority Date: 06/21/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Bathiche, Steven, Lanier, Jaron Zepel
• Primary Examiner(s): Mahmud, Farhan
• Application Number:
  US14/949,550
• Publication Number:
  US 20160080736A1
• Time in Patent Office: 1,331 Days
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/32 using arrays of controllable light sources; using moving apertures or moving light sources
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307
• CPC Class Codes: H04N 13/356 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/368 for two or more viewers
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

Described herein is a multi-view display (based on spatial and/or temporal multiplexing) having an optimization mechanism that dynamically adjust views based upon detected state changes with respect to one or more views. The optimization mechanism determines viewing parameters (e.g., brightness and/or colors) for a view based upon a current position of the view, and/or on the multi-view display'"'"'s capabilities. The state change may correspond to the view (a viewer'"'"'s eye) moving towards another viewing zone, in which event new viewing parameters are determined, which may be in anticipation of entering the zone. Another state change corresponds to more views being needed than the display is capable of outputting, whereby one or more existing views are degraded, e.g., from 3D to 2D and/or from a personal video to a non-personal view. Conversely, a state change corresponding to excess capacity becoming available can result in enhancing a view to 3D and/or personal.

Claims

1. A method comprising:

determining a number of views that a multi-view display is capable of providing, the number of views being limited by both spatial multiplexing and temporal multiplexing capabilities of the multi-view display;

identifying a required number of views to display three-dimensional video to a plurality of viewers using the multi-view display;

determining particular times at which to illuminate individual light sources of the multi-view display to display the three-dimensional video to the plurality of viewers;

detecting presence of a new viewer of the multi-view display, wherein providing three-dimensional video to the plurality of viewers and the new viewer requires more views than the multi-view display is capable of providing; and

responsive to detecting the presence of the new viewer of the multi-view display;

selecting a particular viewer, other than the new viewer, to degrade via temporal multiplexing, the particular viewer being selected for degrading based at least on a temporal order in which the particular viewer began viewing the multi-view display relative to other viewers of the plurality; and

degrading the particular viewer from three-dimensional video having two temporally-multiplexed views to two-dimensional video having a single temporally-multiplexed view while continuing to provide three-dimensional video to the other viewers, the degrading comprising adjusting the particular times at which the individual light sources are illuminated.

2. The method of claim 1, further comprising:

after degrading the particular viewer to two-dimensional video, upgrading the particular viewer back to three-dimensional video by further adjusting the particular times at which the individual light sources are illuminated.

3. The method of claim 2, further comprising:

detecting that the new viewer is no longer viewing the multi-view display; and

upgrading the particular viewer back to the three-dimensional video responsive to detecting that the new viewer is no longer viewing the multi-view display.

4. The method of claim 3, further comprising:

determining when each of the plurality of viewers began viewing the multi-view display; and

selecting the particular viewer for degrading based at least on the particular viewer being the most recent viewer of the plurality to begin viewing the multi-view display.

5. A system comprising:

a multi-view display device having a specified frame rate and capable of providing a frame-rate limited number of views, the multi-view display device having a directed backlight with associated light sources; and

one or more processors configured via logic to;

detect a plurality of viewers of the multi-view display device;

determine whether the frame-rate limited number of views provides sufficient capacity to provide three-dimensional views to the plurality of viewers;

when the frame-rate limited number of views provides sufficient capacity to provide the three-dimensional views to the plurality of viewers, control the multi-view display device to generate the three-dimensional views for the plurality of viewers by manipulating temporal multiplexing parameters of the multi-view display device that control when the light sources of the directed backlight are illuminated; and

when an additional viewer is present and the frame-rate limited number of views does not provide sufficient capacity to provide the three-dimensional views to the plurality of viewers and the additional viewer, control the multi-view display device by;

selecting a particular viewer to degrade via the temporal multiplexing parameters, the particular viewer being selected based at least on talking by the particular viewer; and

degrading a particular three-dimensional view for the particular viewer by further manipulating the temporal multiplexing parameters of the multi-view display device that control when the light sources of the directed backlight are illuminated.

6. The system of claim 5, wherein the frame-rate limited number of views is also limited based at least on spatial multiplexing capabilities of the multi-view display device.

7. The system of claim 6, wherein the one or more processors are configured via the logic to:

control vertical columns of pixels of the multi-view display device to generate the three-dimensional views and to degrade the particular three-dimensional view.

8. The system of claim 5, further comprising an eye tracker configured to track eyes of the plurality of viewers, wherein the one or more processors are configured via the logic to:

detect that the additional viewer is present based at least on information provided by the eye tracker.

9. The system of claim 8, wherein the one or more processors are configured via the logic to:

degrade the particular three-dimensional view to a two-dimensional view to obtain an available view; and

using the available view, provide another three-dimensional view to the additional viewer.

10. The system of claim 5, wherein the one or more processors are configured via the logic to:

determine that the particular viewer is currently talking; and

select the particular viewer to degrade based at least on the current talking by the particular viewer.

11. The system of claim 5, wherein the one or more processors are configured via the logic to:

identify multiple talking viewers of the multi-view display device; and

select the particular viewer to degrade based at least the particular viewer talking more than other talking viewers.

12. A system comprising:

a display device having a specified frame rate and a frame-rate limited number of views that the display device is capable of providing;

a hardware processor; and

logic which, when executed by the hardware processor, causes the hardware processor to;

track the presence of viewers of the display device;

control the display device to provide three-dimensional views to the viewers of the display device by manipulating temporal multiplexing parameters of the display device that control when light sources of the display device are illuminated;

detect new viewers of the display device;

when providing new views to the new viewers will exceed the frame-rate limited number of views that the display device is capable of providing, degrade other viewers to obtain available views, the other viewers being degraded in time order based at least on when the other viewers began viewing the display device; and

use the available views to provide the new views to the new viewers by further manipulating the temporal multiplexing parameters.

13. The system of claim 12, wherein the logic, when executed by the hardware processor, causes the hardware processor to:

provide three-dimensional views to the new viewers.

14. The system of claim 13, wherein the logic, when executed by the hardware processor, causes the hardware processor to:

degrade the other viewers from three-dimensional views to two-dimensional views.

15. The system of claim 14, wherein the logic, when executed by the hardware processor, causes the hardware processor to:

detect the new viewers by detecting that the new viewers have entered a room with the display device.

16. The system of claim 12, wherein, prior to being degraded, each of the three-dimensional views is a personal three-dimensional view that is not visible to at least one other viewer of the display device.

17. The system of claim 16, wherein the display device comprises a directed collimated backlight and the light sources are associated with the directed collimated backlight.

18. The system of claim 17, wherein the logic, when executed by the hardware processor, causes the hardware processor to:

receive image information from one or more cameras; and

using the image information received from the one or more cameras, track the presence of the viewers and detect the new viewers.

19. The system of claim 18, wherein the display device comprises a lenticular array or lenslet.

20. The system of claim 12, wherein the system comprises a memory storing the logic.